To the Cloud
The company decided to migrate the main services to the Google Cloud. That required rewriting the services from Apache Spark to Apache Beam and using Google Dataflow to run the services. During the migration, we needed to ensure that the services were still running and that the data was consistent across the two platforms.