Senior Data Engineer at Greater London Authority | AWS | Lambda | Glue | Redshift | Bedrock | Azure Data Factory | Big Data | PySpark | Python | DataBricks | GenAI (Mistral, LLama, DeepSeek, OpenAI)
Develops and maintains highly scalable, secure and reliable data pipelines. Accustomed to working closely with system architects, software architects and design analysts to understand business or industry requirements to develop comprehensive data models. Proficient at developing database architectural strategies at the modeling, design and implementation stages.
I am a Consultant comfortable working both with internal and customer stakeholders. 12 years experience working on complex customer data projects.
LANGUAGES :
AWS Bedrock, AWS Lambda, AWS Glue, AWS Redshift, AWS s3, Postgres, AWS SQS, AWS SNS, Docker Containers, AWS Batch, Garnet, SQL, Spark, Scala, Python, Hive Query Language, Pig, UNIX, PL/SQL, Kafka, Big Query, Mistral Gen AI, LLama, Deepseek
DEVELOPMENT Toolkit :
Pycharm, VS Code, Intellij, Cloud Shell, Databricks, Vermillion, Pycharm, Azure Data Studio
DATABASES :
Amazon Redshift, Postgres, Hive, SQL Server, IBM DB2,Oracle,SQL
PLATFORMS :
AWS, Hadoop, Google Cloud Platform, Azure Data Factory, Azure Synapse Analytics, Kubernetes
Domain of Work :
Data driven applications for big data for Banking and Finance stream using AWS Bedrock Gen AI services.
| ๐ Nationality | ๐ฎ๐ณ India |
| ๐ก Residency | ๐ฌ๐ง United Kingdom |
| ๐ Location | ๐ฌ๐ง United Kingdom |
|
|
rok.co/@karanluthrabristol |
|
|
sdfljasfjkhsdfajsf โญ๏ธ Upgrade to Premium to contact |
| Skilled in | aws bedrock aws lambda aws glue aws redshift aws s3 postgres aws sqs aws sns docker containers aws batch garnet sql spark scala python hive query language pig unix pl sql kafka big query mistral gen ai llama deepseek |
| Fluent in | englishhindi |
| Preferred annual pay (min) | $100,000/year |
| Preferred hourly pay (min) | $30/hour |
| Last seen | 9 months ago |
| Signed up | 9 months ago |
| Badges |
๐จโ๐ป Remote worker |
2024 - Now: Sr Data Engineer @ Greater London Authority
2023 - 2024: Senior Data Engineer @ Valtech
2016 - 2022: Lead Data Engineer @ Tata Consultancy Services
2014 - 2015: Senior Software Engineer @ Accenture
2011 - 2013: Software Analyst @ Employwise
2007 - 2011: Bachelor of Technology @ Guru Gobind Singh Indraprastha University