Fantastic session with Anuj! He provided invaluable guidance on data architecture, optimization strategies, and career progression. His insights on emerging technologies and workflow automation were eye-opening. Anuj's expertise as a team lead really shines through. Highly recommended for data engineers at any stage!
I am working as a technical Team Lead in Altimetrik(SLK).
As an experienced Teachnical Team Lead @ Altimetrik ,I am handling a team of 5 people which along with me specializes in Stream and Batch Data Processing, Data Modelling, and a robust tech stack including Apache Flink, Kafka, Druid, Parquet, Avro, SQL, MongoDB, Redis, and AWS services like EC2, S3, Lambda, and more. I excel in optimizing performance across various domains:
Query Optimization: Improved SQL query performance by 30%, reduced ETL pipeline runtime by 60%, and implemented Redis caching for a 40% decrease in query execution time.
Data Storage: Enhanced data modeling with star schemas, achieving a 40% reduction in query response time, and implemented efficient indexing strategies resulting in 50% faster query performance.
Big Data Technologies: Optimized Hadoop and Spark for a 50% reduction in job execution time, and implemented Kafka for real-time data processing with sub-5 second latency.
Monitoring and Testing: Utilized CloudWatch for proactive monitoring and JMeter for performance testing, ensuring optimized resource allocation and scalability.
Data Governance: Implemented data validation and lineage tracking, reducing error rates by 25% and ensuring high data quality and integrity.
My expertise extends to distributed systems, microservices architecture, REST APIs ,FAST APIs, Python, Generative AI, and proficiency in project management and team leadership.