Remote worker with 6+ years of experience - Last seen 1 year ago

Senior Data Engineer with over 5 years of experience in data pipeline development, cloud solutions, and data engineering best practices. Proven ability to orchestrate and consolidate data lakes, facilitating scalable and robust data solutions. Expertise in AWS services (S3, EMR, Lambda, Glue, Redshift), Python, Spark, and Terraform, with hands-on experience in large-scale data migrations and cost-reduction strategies. Skilled in ETL, data mesh implementation, and creating automated data quality solutions to ensure data accuracy and reliability across projects.

I have professional experience with:
- Development and maintenance of data pipelines in cloud environments;
- ETL with Python and Spark;
- Cloud services: AWS (S3, EMR, Lambda, Glue, Database Migration Service
(DMS), Redshift, Step Functions, Athena, SQS, SNS, AppFlow, EC2);
- Data Lakehouse Architecture,
- Databases: RDS, MySQL, PostgreSQL, DynamoDB, SAP Hana;
-IaC (Infrastructure as Code) with Terraform, YAML and AWS CloudFormation;
- CI/CD with GitHub Actions and AWS CodePipeline.
- Development of data quality with Glue Data Quality using Python and PyDeequ/Deequ.

🛂 Nationality	🇧🇷 Brazil
🏡 Residency	🇧🇷 Brazil
📍 Location	🇧🇷 Brazil
Remote OK	rok.co/@lucas_lavnicki
LinkedIn	sdfljasfjkhsdfajsf ⭐️ Upgrade to Premium to contact
Skilled in	python etl spark s3 emr lambda aws glue dms redshift step functions athena sqs sns appflow ec2 data lake data lakehouse rds mysql postgresql dynamodb sap hana terraform yaml aws cloudformation ci cd data quality data mesh aws cloud solutions data solutions
Fluent in	portugueseenglish
Preferred annual pay (min)	$45,000/year
Preferred hourly pay (min)	$30/hour
Last seen	1 year ago
Signed up	1 year ago
Badges	🎖 Early adopter