Experience with building data pipelines and applications to stream and process datasets at low latencies. Experience in GCP, Big Query and DataProc. Experience with complex data modelling, ETL design, and using large databases in a business environment Proficiency with Linux command line and writing shell scripts. Experience with languages like Python, Java Experience with Big Data technologies such as Hive/Spark. Experience in ingesting the streaming data using kafka and spark. Experience in handling TeraBytes of data and meeting the business requirements of the data with in the SLA. Mentoring the ops teams to monitor the system and providing them the automated scripts which helps them to monitor and generating the alerts for any failures to address them quickly. Excellent verbal and written communication; Proven interpersonal skills and ability to convey key insights from complex analyses in summarised business terms;