\nWe currently seeking a Senior Data Engineer with 5-7 years’ experience. The ideal candidate would have the ability to work independently within an AGILE working environment and have experience working with cloud infrastructure leveraging tools such as Apache Airflow, Databricks, DBT and Snowflake. A familiarity with real-time data processing and AI implementation is advantageous.  \n\n\n\nResponsibilities:\n* Design, build, and maintain scalable and robust data pipelines to support analytics and machine learning models, ensuring high data quality and reliability for both batch & real-time use cases.\n* Design, maintain, optimize data models and data structures in tooling such as Snowflake and Databricks. \n* Leverage Databricks for big data processing, ensuring efficient management of Spark jobs and seamless integration with other data services.\n* Utilize PySpark and/or Ray to build and scale distributed computing tasks, enhancing the performance of machine learning model training and inference processes.\n* Monitor, troubleshoot, and resolve issues within data pipelines and infrastructure, implementing best practices for data engineering and continuous improvement.\n* Diagrammatically document data engineering workflows. \n* Collaborate with other Data Engineers, Product Owners, Software Developers and Machine Learning Engineers to implement new product features by understanding their needs and delivery timeously. \n\n\n\nQualifications:\n* Minimum of 3 years experience deploying enterprise level scalable data engineering solutions.\n* Strong examples of independently developed data pipelines end-to-end, from problem formulation, raw data, to implementation, optimization, and result.\n* Proven track record of building and managing scalable cloud-based infrastructure on AWS (incl. S3, Dynamo DB, EMR). \n* Proven track record of implementing and managing of AI model lifecycle in a production environment.\n* Experience using Apache Airflow (or equivalent) , Snowflake, Lucene-based search engines.\n* Experience with Databricks (Delta format, Unity Catalog).\n* Advanced SQL and Python knowledge with associated coding experience.\n* Strong Experience with DevOps practices for continuous integration and continuous delivery (CI/CD).\n* Experience wrangling structured & unstructured file formats (Parquet, CSV, JSON).\n* Understanding and implementation of best practices within ETL end ELT processes.\n* Data Quality best practice implementation using Great Expectations.\n* Real-time data processing experience using Apache Kafka Experience (or equivalent) will be advantageous.\n* Work independently with minimal supervision.\n* Takes initiative and is action-focused.\n* Mentor and share knowledge with junior team members.\n* Collaborative with a strong ability to work in cross-functional teams.\n* Excellent communication skills with the ability to communicate with stakeholders across varying interest groups.\n* Fluency in spoken and written English.\n\n\n\n\n\n#LI-RT9\n\n\nEdelman Data & Intelligence (DXI) is a global, multidisciplinary research, analytics and data consultancy with a distinctly human mission.\n\n\nWe use data and intelligence to help businesses and organizations build trusting relationships with people: making communications more authentic, engagement more exciting and connections more meaningful.\n\n\nDXI brings together and integrates the necessary people-based PR, communications, social, research and exogenous data, as well as the technology infrastructure to create, collect, store and manage first-party data and identity resolution. DXI is comprised of over 350 research specialists, business scientists, data engineers, behavioral and machine-learning experts, and data strategy consultants based in 15 markets around the world.\n\n\nTo learn more, visit: https://www.edelmandxi.com \n\n#Salary and compensation\n No salary data published by company so we estimated salary based on similar jobs related to Python, DevOps, Cloud, Senior, Junior and Engineer jobs that are similar:\n\n $60,000 — $110,000/year\n
\n\n#Benefits\n 💰 401(k)\n\n🌎 Distributed team\n\n⏰ Async\n\n🤓 Vision insurance\n\n🦷 Dental insurance\n\n🚑 Medical insurance\n\n🏖 Unlimited vacation\n\n🏖 Paid time off\n\n📆 4 day workweek\n\n💰 401k matching\n\n🏔 Company retreats\n\n🏬 Coworking budget\n\n📚 Learning budget\n\n💪 Free gym membership\n\n🧘 Mental wellness budget\n\n🖥 Home office budget\n\n🥧 Pay in crypto\n\n🥸 Pseudonymous\n\n💰 Profit sharing\n\n💰 Equity compensation\n\n⬜️ No whiteboard interview\n\n👀 No monitoring system\n\n🚫 No politics at work\n\n🎅 We hire old (and young)\n\n

About the Role: \n\nAs a Senior Engineer on the Developer Productivity team, you will spearhead the effort to build systems and automation that are the development, build, and delivery backbone of the Motive platform across SaaS, Mobile, and Embedded/IoT products. With a focus on secure and highly scalable distributed services, you will leverage technology such as Kubernetes, ArgoCD, ProwCI, Tekton, Bazel, and whatever the future may hold to advance an automated and easy to use and maintain ecosystem to support Golang, Ruby on Rails, and Python services (as well as Kotlin and C for our Mobile and Embedded friends!). If creating direction for and implementing top-tier development tools, automation, infrastructure, and release pipelines, while providing guidance and mentorship to fellow engineers excites you, then Motive has the perfect role for you.\nWhat You’ll Do: \n\n\n* Help define the direction and initiatives for the team and platform.\n\n* Strategize and build fully automated bootstrapping and delivery pipelines. \n\n* Progress and evangelize self-service engineering technologies and approaches.\n\n* Advance the local development experience while maintaining consistency.\n\n* Build self-healing infrastructure that enables fast, robust automated testing.\n\n* Improve the performance and reliability of existing systems.\n\n* Host Brown Bag sessions, demos, and more to drive adoption and collaboration.\n\n* Coach and mentor team engineers and collaborate on designs.\n\n\n\nWhat We’re Looking For: \n\nWe are looking for someone with advanced knowledge and experience in creating and improving systems that will help the engineering org to function more efficiently. This individual will have prior experience in some or all of the following:\n\n\n* Building CI/CD infrastructure with multiple pipeline solutions over the years ( such as Tekton, Prow, CircleCI, Jenkins, Spinnaker, Github Actions, etc.)\n\n* Improving the SDLC release process.\n\n* Streamlining microservice creation mechanisms.\n\n* Streamlining developer's local environments (Ansible, local kubernetes, etc.)\n\n* Git flow and versioning strategy expertise.\n\n* Working with mechanisms that facilitate reproducible builds across the org.\n\n* Experience improving the developer experience with multiple stakeholders in a large organization.\n\n* Experience in Golang, Ruby on Rails, Python or similar languages.\n\n* Working knowledge of AWS services and technologies.\n\n* Experience with infrastructure as code and configuration management (Terraform, Ansible, Helm, etc.)\n\n* Experience with large scale distributed release management processes. Experience with Bazel is a plus.\n\n* Experience in a containerized world with orchestration frameworks such as Kubernetes.\n\n* 5+ years engineering experience\n\n\n\n\nBonus Skills to have\n\n\n* \n\n\n* Experience with Gerrit and Android OS (AOSP) build systems\n\n* Experience with embedded systems builds and compiles\n\n\n\n\n\n\n\n\n  \n\n#Salary and compensation\n No salary data published by company so we estimated salary based on similar jobs related to Python, DevOps, Ruby, Mobile, Senior, Android and Engineer jobs that are similar:\n\n $60,000 — $110,000/year\n
\n\n#Benefits\n 💰 401(k)\n\n🌎 Distributed team\n\n⏰ Async\n\n🤓 Vision insurance\n\n🦷 Dental insurance\n\n🚑 Medical insurance\n\n🏖 Unlimited vacation\n\n🏖 Paid time off\n\n📆 4 day workweek\n\n💰 401k matching\n\n🏔 Company retreats\n\n🏬 Coworking budget\n\n📚 Learning budget\n\n💪 Free gym membership\n\n🧘 Mental wellness budget\n\n🖥 Home office budget\n\n🥧 Pay in crypto\n\n🥸 Pseudonymous\n\n💰 Profit sharing\n\n💰 Equity compensation\n\n⬜️ No whiteboard interview\n\n👀 No monitoring system\n\n🚫 No politics at work\n\n🎅 We hire old (and young)\n\n
\n\n#Location\nNew York City, New York, United States

\nAppnovation helps brands thrive through innovative, people-inspired experiences and solutions. By embracing the powerful combination of technology and agility, we seamlessly integrate strategy, experience, design, development and analytics.\n\nWe create standout digital experiences by collaborating with brands to understand the individual challenges and goals for every initiative. Focusing on our clients’ customers, we effectively combine empathy, evidence and real-world insight so that solutions are derived from truth and meaning. Appnovation is an award-winning team dedicated to inspiring possibilities.\n\nTechnology is foundational to all of Appnovation’s offerings, from consulting to digital innovation, to digital product and service creation. The technology department is focused on delivering software solutions that enable rich consumer experiences, from mobile and web applications to advanced analytics and machine learning, to content and engagement management service enablement platforms.\n\nInherent throughout our tech capabilities is deep expertise in the Software Development Life Cycle, a drive for creativity, a passion for the craft, and collaboration with other disciplines - all foundational ingredients in successful digital experiences and client partnerships.\n\nThis role is based out of the Cardiff office with a lot of remote flexibility but can also be based out of our other offices which we have situated across the UK.\n\n \n\nYOU WILL HAVE AN OPPORTUNITY TO:\n\n\nWorking within an agile and/or waterfall environment to identify any issues with product/testing requirements\n\nAssisting with preparation of all prescribed quality assurance artifacts including, but not limited to, Master Test Strategy and Plan, Functional Test Plan, etc.\n\nPreparing and participating in performance, and security testing as required\n\nConduct quality assurance defect tracking reports\n\nParticipating and/or reviewing documentation and test results in all QA test phases, such as requirements validation, unit, integration, functional, and regression testing\n\nDeveloping the QA Test Cases according to the Master Test Plan\n\nPerforming QA testing and report issues as required\n\nWalking through test cases and the test plan with the QA Lead prior to execution\n\n\n\n\n \n\nJOB SKILLS AND REQUIREMENTS:\n \n\nAs an Associate Quality Assurance (QA) Analyst you will be responsible for providing QA support for a portfolio of projects, enhancements, and support initiatives. The role involves testing, planning, and working closely with the team of Developers and other QAs to ensure the product is meeting all quality standards.\n \n\nMust Haves:\n\n\n2+ years of formal testing experience\n\nUnderstanding of the quality assurance discipline, the defect lifecycle management processes, and the software commonly used for test planning and defect tracking (eg. Jira, Bugzilla, etc.)\n\nExperience in developing test plans, writing test scripts, developing use cases, implementing automated testing, executing test team activities, and assisting business users through user acceptance test processes\n\nExperience and knowledge of software quality tools (ie. test case management, project planning, defect management, automation)\n\nExperience with web/mobile application testing (browser compatibility, responsive testing, etc.)\n\nExperienced in web/mobile application technologies such as HTML, CSS, Javascript, PHP, Python, Java, Ruby, etc.  \n\nExperience testing in Window OS, Mac OS, Mobile OS (Android, iOS), etc.\n\nUnderstanding of user centric design principles, content, navigation, usability, behavioural analytics tagging, accessibility, SEO, localization/multi-lingual and personalization considerations\n\nUnderstanding of accessibility principles, standards, compliance, testing and validation\n\nUnderstanding of cloud computing architecture, services and platforms\n\nUnderstanding of DevOps principles, processes and tools (e.g. IaC, CI/CD and orchestration)\n\nUnderstanding of agile principles and methodologies\n\n\n\n \n\nNice to Haves: \n\n\nExperience with automated test scripting and implementation using BDD frameworks such as Behat or Cucumber\n\nExperience with testing APIs using tools such as Postman\n\nExperience with SQL and relational databases\n\nExperience with Python scripting and Pytest\n\nUnderstanding of security and privacy by design principles, process and tools\n\nUnderstanding of data driven and/or machine learning applications\n\n\n\n\n\n\nWHO YOU ARE:\n\n\nProactive in raising potential risks/concerns\n\nAbility to multitask effectively on multiple projects and provide leadership\n\nAbility to identify potential risks and communicate to project leadership team\n\nFormal software testing training or certification\n\nAbility to take ownership of tasks and projects assigned with minimal supervision\n\nHighly collaborative and dynamic\n\nResults-oriented with creative problem-solving skills\n\nClient centric and responsive\n\nClear, concise, and articulate communication\n\n\n\n\n\n \n\n \n\n#Salary and compensation\n No salary data published by company so we estimated salary based on similar jobs related to Analyst, DevOps, Cloud, Python and Mobile jobs that are similar:\n\n $70,000 — $120,000/year\n
\n\n#Benefits\n 💰 401(k)\n\n🌎 Distributed team\n\n⏰ Async\n\n🤓 Vision insurance\n\n🦷 Dental insurance\n\n🚑 Medical insurance\n\n🏖 Unlimited vacation\n\n🏖 Paid time off\n\n📆 4 day workweek\n\n💰 401k matching\n\n🏔 Company retreats\n\n🏬 Coworking budget\n\n📚 Learning budget\n\n💪 Free gym membership\n\n🧘 Mental wellness budget\n\n🖥 Home office budget\n\n🥧 Pay in crypto\n\n🥸 Pseudonymous\n\n💰 Profit sharing\n\n💰 Equity compensation\n\n⬜️ No whiteboard interview\n\n👀 No monitoring system\n\n🚫 No politics at work\n\n🎅 We hire old (and young)\n\n
\n\n#Location\nCardiff, Wales, United Kingdom