\nWe currently seeking a Senior Data Engineer with 5-7 years’ experience. The ideal candidate would have the ability to work independently within an AGILE working environment and have experience working with cloud infrastructure leveraging tools such as Apache Airflow, Databricks, DBT and Snowflake. A familiarity with real-time data processing and AI implementation is advantageous.  \n\n\n\nResponsibilities:\n* Design, build, and maintain scalable and robust data pipelines to support analytics and machine learning models, ensuring high data quality and reliability for both batch & real-time use cases.\n* Design, maintain, optimize data models and data structures in tooling such as Snowflake and Databricks. \n* Leverage Databricks for big data processing, ensuring efficient management of Spark jobs and seamless integration with other data services.\n* Utilize PySpark and/or Ray to build and scale distributed computing tasks, enhancing the performance of machine learning model training and inference processes.\n* Monitor, troubleshoot, and resolve issues within data pipelines and infrastructure, implementing best practices for data engineering and continuous improvement.\n* Diagrammatically document data engineering workflows. \n* Collaborate with other Data Engineers, Product Owners, Software Developers and Machine Learning Engineers to implement new product features by understanding their needs and delivery timeously. \n\n\n\nQualifications:\n* Minimum of 3 years experience deploying enterprise level scalable data engineering solutions.\n* Strong examples of independently developed data pipelines end-to-end, from problem formulation, raw data, to implementation, optimization, and result.\n* Proven track record of building and managing scalable cloud-based infrastructure on AWS (incl. S3, Dynamo DB, EMR). \n* Proven track record of implementing and managing of AI model lifecycle in a production environment.\n* Experience using Apache Airflow (or equivalent) , Snowflake, Lucene-based search engines.\n* Experience with Databricks (Delta format, Unity Catalog).\n* Advanced SQL and Python knowledge with associated coding experience.\n* Strong Experience with DevOps practices for continuous integration and continuous delivery (CI/CD).\n* Experience wrangling structured & unstructured file formats (Parquet, CSV, JSON).\n* Understanding and implementation of best practices within ETL end ELT processes.\n* Data Quality best practice implementation using Great Expectations.\n* Real-time data processing experience using Apache Kafka Experience (or equivalent) will be advantageous.\n* Work independently with minimal supervision.\n* Takes initiative and is action-focused.\n* Mentor and share knowledge with junior team members.\n* Collaborative with a strong ability to work in cross-functional teams.\n* Excellent communication skills with the ability to communicate with stakeholders across varying interest groups.\n* Fluency in spoken and written English.\n\n\n\n\n\n#LI-RT9\n\n\nEdelman Data & Intelligence (DXI) is a global, multidisciplinary research, analytics and data consultancy with a distinctly human mission.\n\n\nWe use data and intelligence to help businesses and organizations build trusting relationships with people: making communications more authentic, engagement more exciting and connections more meaningful.\n\n\nDXI brings together and integrates the necessary people-based PR, communications, social, research and exogenous data, as well as the technology infrastructure to create, collect, store and manage first-party data and identity resolution. DXI is comprised of over 350 research specialists, business scientists, data engineers, behavioral and machine-learning experts, and data strategy consultants based in 15 markets around the world.\n\n\nTo learn more, visit: https://www.edelmandxi.com \n\n#Salary and compensation\n No salary data published by company so we estimated salary based on similar jobs related to Python, DevOps, Cloud, Senior, Junior and Engineer jobs that are similar:\n\n $60,000 — $110,000/year\n
\n\n#Benefits\n 💰 401(k)\n\n🌎 Distributed team\n\n⏰ Async\n\n🤓 Vision insurance\n\n🦷 Dental insurance\n\n🚑 Medical insurance\n\n🏖 Unlimited vacation\n\n🏖 Paid time off\n\n📆 4 day workweek\n\n💰 401k matching\n\n🏔 Company retreats\n\n🏬 Coworking budget\n\n📚 Learning budget\n\n💪 Free gym membership\n\n🧘 Mental wellness budget\n\n🖥 Home office budget\n\n🥧 Pay in crypto\n\n🥸 Pseudonymous\n\n💰 Profit sharing\n\n💰 Equity compensation\n\n⬜️ No whiteboard interview\n\n👀 No monitoring system\n\n🚫 No politics at work\n\n🎅 We hire old (and young)\n\n

The PlatformDecentraland is the world’s first fully decentralized, Ethereum blockchain-based virtual world, built, governed and owned by its users. It’s a truly unique ecosystem with its own decentralized autonomous organization, currency, marketplace and system of property – and it’s growing fast! New creations are added daily by creators who use proprietary developer tools to make games, puzzles, scenes, artworks – whatever their imaginations allow. Via their personal avatars, users attend live music events, conferences, exhibitions, dance parties and other experiences every day of the year. What began as a proof-of-concept for assigning ownership of digital real estate to users of a blockchain is now an immersive, ever-expanding and richly detailed metaverse, where anything is possible. Check it out at: http://play.decentraland.org/\n\nWhat are we looking for? We are actively seeking a Senior DevOps Engineer to join our team to ensure the metaverse never stops running at scale. Our ideal candidate will join our engineering team, focusing on establishing and sustaining infrastructure (CI/CD), fine-tuning infrastructure costs, contributing to the design of distributed and scalable peer-to-peer systems, and actively engaging in the development of open-source tools to improve the development lifecycle. These tools will be instrumental in bringing up, monitoring, and diagnosing issues with the services of our shared virtual world infrastructure, as well as enhancing the tools utilized by the team for continuous delivery.\nResponsibilities • Encourage and enforce a DevOps culture in the team: define and execute policies upholding best-practices in engineering, security, and design.• Maintain and improve our existing CI/CD pipeline.• Build, scale, maintain, and analyze Unity project builds and deployments to optimize cloud resource usage, reducing costs without impacting performance.• License management.• Help design, build and operate the tooling and automation for clustering, scaling, monitoring and alerting that support our platform products.• Manage the certificate lifecycle and application signing processes for Decentraland's applications to ensure secure distribution and compliance• Manage a Gitlab EE instance.• Optimize the cost of the infrastructure used in every environment.• Apply security patches and update the infra when needed\nRequired Skills • Experience building, deploying, and supporting live production infrastructure using AWS, Cloudflare, Github actions, CircleCI• Experience using Pulumi.• Experience with cost optimization through building services on demand and/or scalable infrastructure.• Experience using the following systems: Grafana, Prometheus, Gitlab.• Experience working with TypeScript/JavaScript.• Passion for crafting a great developer experience through the whole software development lifecycle.• Be able to combine industry best-practices and your innovation with a ground-breaking decentralized infrastructure.• Excellent verbal, written, and graphical communication skills. Ability to work closely with cross-functional teams.• Experience designing SaaS systems adaptable to a wide range of available resources to run the infrastructure.• Deep and vast knowledge of UNIX and Internet protocols: ability to debug any problem using just GNU tools, dtrace, tcpdump, and netcat.\nDesirable Skills• Experience with web technologies, such as Python, WebAssembly, WebRTC or WebGL.• Experience working with game development CI pipelines.• Experience finding security vulnerabilities in servers and web applications.\nConditions and Perks• Fully remote team with flexible working hours• 29 annual PTOs• Long term incentive of tokens, vested in a 4 years period• Annual performance bonus• Brand new equipment for remote work, including laptop, screen and chair• Remote work stipend \n\n#Salary and compensation\n No salary data published by company so we estimated salary based on similar jobs related to Design, SaaS, Ethereum, Music, DevOps, Cloud, Senior and Engineer jobs that are similar:\n\n $75,000 — $122,500/year\n
\n\n#Benefits\n 💰 401(k)\n\n🌎 Distributed team\n\n⏰ Async\n\n🤓 Vision insurance\n\n🦷 Dental insurance\n\n🚑 Medical insurance\n\n🏖 Unlimited vacation\n\n🏖 Paid time off\n\n📆 4 day workweek\n\n💰 401k matching\n\n🏔 Company retreats\n\n🏬 Coworking budget\n\n📚 Learning budget\n\n💪 Free gym membership\n\n🧘 Mental wellness budget\n\n🖥 Home office budget\n\n🥧 Pay in crypto\n\n🥸 Pseudonymous\n\n💰 Profit sharing\n\n💰 Equity compensation\n\n⬜️ No whiteboard interview\n\n👀 No monitoring system\n\n🚫 No politics at work\n\n🎅 We hire old (and young)\n\n
\n\n#Location\nRemote - Worldwide