Jafsal M A
Data Engineer | IoT Enthusiast
With over 5 years of experience, I specialize in data extraction and IoT edge development. My expertise covers the full spectrum of data acquisition, from building scalable web scrapers to reverse-engineering mobile apps. I also develop C++ modules for Azure IoT Edge gateways, delivering robust, automated solutions in agile, remote environments with a focus on Python, Scrapy, and modern cloud DevOps tools.
Technical Skills
A snapshot of my technical capabilities.
Professional Experience
My career journey so far.
2024 – Present
- Designed and implemented efficient web scraping strategies using Python, Scrapy, and Playwright.
- Utilized ScrapydWeb for spider management, deployment, and monitoring.
- Managed a variety of proxy services to ensure reliable and high-scale data extraction.
- Contributed to internal tool and process improvement initiatives for enhanced data acquisition.
2021 – 2024
- Spearheaded development of scalable spiders for global e-commerce sites using Python and Golang.
- Extended data scraping to Android apps, including reverse-engineering APKs and bypassing SSL pinning.
- Automated mobile app crawling using Appium, BrowserStack, and LambdaTest.
- Managed proxy infrastructure and implemented data storage with Elasticsearch and Cassandra.
2020 – 2021
- Developed C++ Edge modules for gateways and Azure communication for a major Dutch conglomerate.
- Integrated Azure IoT Hub and Azure IoT Edge services.
- Implemented CI/CD pipelines for Azure deployment using Git and Azure DevOps.
- Worked with industrial communication protocols like MODBUS within an Agile PLM environment.
2018 – 2020
- Scraped data from various websites with a focus on e-commerce using Python libraries.
- Maintained and updated crawlers for product attribute enrichment.
- Automated processes like report generation and validation using Python scripts.
- Collaborated with cross-functional teams to ensure high data quality.
Project Highlights
A selection of my key projects.
Beyond the Code
When I'm not architecting data pipelines, I'm exploring new places or enjoying a good drive. Here's a glimpse into my interests outside of the tech world.
Explored the beautiful tea plantations and misty hills.
Enjoyed the stunning cliff-side beaches and sunset views.
A memorable trek through the dense forest and wildlife.
Contact Me
Have a question or want to work together?