From Kafka to BigQuery with Spark in Scala
One of the many missions of our Data Engineers is processing and storing all the data we receive from our different sources. Our very own Iron Man and Data Engineer Benjamin has dedicated an article to this topic on our tech blog. If you want to know more about pipeline design and data serialization, click here.
If you like these kinds of topics and want to work on similar projects, please head over to our career page. We are looking for more Data Analysts and Data Engineers.