In the summer of 2021, I got an internship at the most heavily loaded social networking service in post-soviet space – vk.com.

Video ¶

All the research results are summed up in this video:

It is in Russian, but if you really interested you could something out.

Skills ¶

Tons of big data instruments: starting with a ClickHouse and Hadoop with pySpark and following up with AirFlow (DAGs !) Kafka, Azkaban and Zeppelin. Extracting and processing larger files than my laptop hard drive was a challenge, but elegant sampling saved the day.

Personal thoughts ¶

The industry might be challenging, and the majority of co-workers are not keen to teach you something. And that is entirely understandable but mildly infuriating.

I understood that getting bogged down in a routine is not always bad, but that is not what I want to do now.