Seeking opportunities in Big Data, Web Scraping, Spark, and AWS where I can leverage my technical expertise and experience to contribute effectively toward achieving organizational goals. TECHNICAL SKILLS • Palantir Foundry • SQL • AWS • Spark • Python • Requests • Regex • Data Mining • Pandas • Power BI • Selenium • PHP ❖ 4.6 years of expertise in Web Scraping, Big Data technologies, Palantir Foundry, Python, PHP Scripting, and SQL. ❖ Extensive experience with big data technologies, including RDD, Data Frames, and Apache Spark, with a focus on data transformation and analysis. ❖ Proficient in utilizing Spark APIs for data cleansing, exploration, aggregation, transformation, and storage. ❖ Skilled in analysing large datasets using SQL, MySQL for data-driven insights and decision-making. ❖ Scraped data from over 100 websites, organizing data in multiple formats to meet diverse requirements. ❖ Experienced in importing and exporting data between relational databases (RDBMS) and Amazon S3 for optimized storage and retrieval. ~~~~SPECIALIZATION IN Data Engineering / Web Scraping / Data Analyst ~~~~ 1. Web Scraping from any website. 2. Web Scraping from behind the login. 3. Scrape data from Cloud flare protected API. 4. Mobile App Scraping. 5. Browser Automation. ~~~~CAREER HIGHLIGHTS~~~~ 1. Deliver more than 3 sites of data in single day to the client. 2. Complete Analysis and Filtration of more than 5 Sites data in single day. 3. Bypass Cloud fare by making request chaining and cookies management. 4. Use proxies in such a way site cant be track in more than 100 hits a time. ~~~~~Worked On Below Task~~~~ 1. Ecommerce data from Walmart, Amazon, eBay etc. (Weekly, Monthly Basis) 2. Hotels Booking Website Scraping (Weekly, Monthly Basis). 3. Auto Parts Website Scraping (Part Search or catalogue). 4. Restaurants Website Scraping (Multiple Zip codes). 5. Job Portal Website Scraping (High Frequency feeds). 6. Fuel Retailers Website Scraping (With Pricing strategies). 7. Car Rental Website Scraping. (Daily, Weekly, Monthly Basis) Note: If you want to outsource/freelance your data related work please contact me. You can reach me at; 6395570619 ygsid975@gmail.com