\nChainSafe is a leading blockchain research and development firm specializing in infrastructure solutions for the decentralized web. Alongside its contributions to significant ecosystems such as Ethereum, Polkadot, Filecoin, and more, ChainSafe creates solutions for developers across the web3 space utilizing our expertise in gaming, bridging and decentralized storage. As part of the mission to build innovative products for users and better tooling for developers, ChainSafe embodies an open-source and community-oriented ethos.\n\nAt ChainSafe, you’ll be part of a global remote team that believes in the community's vital importance and contributes to advancing humanity with open-source and decentralized technology. To learn more about ChainSafe, look at our website or check out our work on GitHub.\n\nAbout the role\n\nAs a DevOps Engineer SRE for the Infrastructure Team, you will play a vital role in defining and implementing best-practice strategies and guides to ensure the reliability, scalability, and performance of our infrastructure that supports the daily production activities across multiple blockchain ecosystems. This includes multiple cloud & bare metal service providers, based on our containerized stack across linux environments.\n\nYour expertise will contribute to the sophistication of blockchain applications and redefine the boundaries of what's possible within this emerging technological sphere. All work across ChainSafe will be open-source, ensuring expansive opportunities for deep contribution and collaborative efforts across various web3 blockchains and ecosystems.\nResponsibilities\n\nWhat you will be doing\n\n\n* Oversee and enhance the health, performance, and security of environments, servers, and applications across the entire technology stack, including various blockchain services and full nodes.\n\n\n* Engage in managing various global environments, considering resources and latency to their observed regions\n\n\n\n\n\n* Be on-call, able to respond promptly outside of business hours\n\n* Implement automation efforts around builds, deployment, and automatic scaling\n\n* Work directly with the development and support teams to resolve issues\n\n* Design and implement procedures related to ChainSafe’s infrastructure operations\n\n\n* Execute deployments and network upgrade\n\n* Run and improve the incident response program\n\n\n\n\n\n* Provide training and guidance for other members of the infrastructure team, ensuring round-the-clock node operation and incident response.\n\n* Document and communicate technical details via open-source documentation\n\n* Collaborate with various internal teams and the wider community to build, expand, and scale ChainSafe’s infrastructure architecture, by tapping into new trends and opportunities highlighted by internal data, blockchain research, and the wider blockchain ecosystem\n\n\n\nRequirements\n\n\n* Practical knowledge of at least one programming language (Go, TypeScript, Solidity, or Rust is a big plus)\n\n* Demonstrable experience with modern Infrastructure as Code (IaC) tools (Terraform, Helm, Ansible, etc), automating deployment, and best CI/CD practices and tools.\n\n* 3+ years of experience managing resources in either AWS, GCP, or Azure.\n\n* 3+ years of experience working with Linux.\n\n* 3+ years of experience with monitoring and alerting tools (DataDog, Grafana, Prometheus, etc.)\n\n* 3+ years of experience implementing distributed tracing, monitoring, and logging systems using OpenTelemetry Protocol\n\n* 3+ years of experience building and participating in incident response systems (PagerDuty, etc) and handling the emergency response to production environment failures.\n\n* Excellent communication skills with the ability to document and convey technical details clearly\n\n* Ability to work autonomously as well as with the wider team\n\n\n\nAs a plus:\n\n\n* Experience working in Web3 domain\n\n* Experience working with bare metal deployments\n\n* Experience automating network deployment\n\n* Understanding at least two of the following domains - Web Security, Web3 Security, Cloud Security, Systems Security, and Applied Cryptography.\n\n\n\nHiring Steps\n\n\n* Selected candidates will be invited to a 30–to–45–minute values interview with one or two of our team members\n\n* Technical 60-minute interview with one or two of our engineers.\n\n* Then, candidates will be asked to complete a homework assignment in under 3-4 hours.\n\n* Lastly, a 60-minute call with the hiring team to discuss the results and final interview.\n\n\n\n\nWhy Join ChainSafe\n\nFounded by developers for developers, ChainSafe is a remote-first company with an international team. We continue to provide opportunities for personal and professional growth, value autonomy and responsibility, have a results-driven environment, and offer flexible work hours.\n\nWe care deeply about our values and look for these attributes in every new team member. In addition, we recognize the benefits of cultivating a diverse team and aspire to embed respect for all people into our culture. We encourage women, the LGBTQIA+ community, people of colour, and members of any other group underrepresented in the blockchain space (or tech in general) to apply.\n\nHow to Apply\n\nPlease fill out the Greenhouse application form below and ensure that you attach your resume and link your Github/Gitlab profile or any software project you have contributed to (if applicable). \n\n#Salary and compensation\n No salary data published by company so we estimated salary based on similar jobs related to Web3, DevOps, Cloud, Node and Engineer jobs that are similar:\n\n $70,000 — $110,000/year\n
\n\n#Benefits\n 💰 401(k)\n\n🌎 Distributed team\n\n⏰ Async\n\n🤓 Vision insurance\n\n🦷 Dental insurance\n\n🚑 Medical insurance\n\n🏖 Unlimited vacation\n\n🏖 Paid time off\n\n📆 4 day workweek\n\n💰 401k matching\n\n🏔 Company retreats\n\n🏬 Coworking budget\n\n📚 Learning budget\n\n💪 Free gym membership\n\n🧘 Mental wellness budget\n\n🖥 Home office budget\n\n🥧 Pay in crypto\n\n🥸 Pseudonymous\n\n💰 Profit sharing\n\n💰 Equity compensation\n\n⬜️ No whiteboard interview\n\n👀 No monitoring system\n\n🚫 No politics at work\n\n🎅 We hire old (and young)\n\n
\n\n#Location\nVancouver, British Columbia, Canada

\nChainSafe is a leading blockchain research and development firm specializing in infrastructure solutions for the decentralized web. Alongside its contributions to significant ecosystems such as Ethereum, Polkadot, Filecoin, and more, ChainSafe creates solutions for developers across the web3 space utilizing our expertise in gaming, bridging and decentralized storage. As part of the mission to build innovative products for users and better tooling for developers, ChainSafe embodies an open-source and community-oriented ethos.\n\nAt ChainSafe, you’ll be part of a global remote team that believes in the community's vital importance and contributes to advancing humanity with open-source and decentralized technology. To learn more about ChainSafe, look at our website or check out our work on GitHub.\n\nAbout the role\n\nAs a DevOps Engineer SRE for the Infrastructure Team, you will play a vital role in defining and implementing best-practice strategies and guides to ensure the reliability, scalability, and performance of our infrastructure that supports the daily production activities across multiple blockchain ecosystems. This includes multiple cloud & bare metal service providers, based on our containerized stack across linux environments.\n\nYour expertise will contribute to the sophistication of blockchain applications and redefine the boundaries of what's possible within this emerging technological sphere. All work across ChainSafe will be open-source, ensuring expansive opportunities for deep contribution and collaborative efforts across various web3 blockchains and ecosystems.\nResponsibilities\n\nWhat you will be doing\n\n\n* Oversee and enhance the health, performance, and security of environments, servers, and applications across the entire technology stack, including various blockchain services and full nodes.\n\n\n* Engage in managing various global environments, considering resources and latency to their observed regions\n\n\n\n\n\n* Be on-call, able to respond promptly outside of business hours\n\n* Implement automation efforts around builds, deployment, and automatic scaling\n\n* Work directly with the development and support teams to resolve issues\n\n* Design and implement procedures related to ChainSafe’s infrastructure operations\n\n\n* Execute deployments and network upgrade\n\n* Run and improve the incident response program\n\n\n\n\n\n* Provide training and guidance for other members of the infrastructure team, ensuring round-the-clock node operation and incident response.\n\n* Document and communicate technical details via open-source documentation\n\n* Collaborate with various internal teams and the wider community to build, expand, and scale ChainSafe’s infrastructure architecture, by tapping into new trends and opportunities highlighted by internal data, blockchain research, and the wider blockchain ecosystem\n\n\n\nRequirements\n\n\n* Practical knowledge of at least one programming language (Go, TypeScript, Solidity, or Rust is a big plus)\n\n* Demonstrable experience with modern Infrastructure as Code (IaC) tools (Terraform, Helm, Ansible, etc), automating deployment, and best CI/CD practices and tools.\n\n* 3+ years of experience managing resources in either AWS, GCP, or Azure.\n\n* 3+ years of experience working with Linux.\n\n* 3+ years of experience with monitoring and alerting tools (DataDog, Grafana, Prometheus, etc.)\n\n* 3+ years of experience implementing distributed tracing, monitoring, and logging systems using OpenTelemetry Protocol\n\n* 3+ years of experience building and participating in incident response systems (PagerDuty, etc) and handling the emergency response to production environment failures.\n\n* Excellent communication skills with the ability to document and convey technical details clearly\n\n* Ability to work autonomously as well as with the wider team\n\n\n\nAs a plus:\n\n\n* Experience working in Web3 domain\n\n* Experience working with bare metal deployments\n\n* Experience automating network deployment\n\n* Understanding at least two of the following domains - Web Security, Web3 Security, Cloud Security, Systems Security, and Applied Cryptography.\n\n\n\nHiring Steps\n\n\n* Selected candidates will be invited to a 30–to–45–minute values interview with one or two of our team members\n\n* Technical 60-minute interview with one or two of our engineers.\n\n* Then, candidates will be asked to complete a homework assignment in under 3-4 hours.\n\n* Lastly, a 60-minute call with the hiring team to discuss the results and final interview.\n\n\n\n\nWhy Join ChainSafe\n\nFounded by developers for developers, ChainSafe is a remote-first company with an international team. We continue to provide opportunities for personal and professional growth, value autonomy and responsibility, have a results-driven environment, and offer flexible work hours.\n\nWe care deeply about our values and look for these attributes in every new team member. In addition, we recognize the benefits of cultivating a diverse team and aspire to embed respect for all people into our culture. We encourage women, the LGBTQIA+ community, people of colour, and members of any other group underrepresented in the blockchain space (or tech in general) to apply.\n\nHow to Apply\n\nPlease fill out the Greenhouse application form below and ensure that you attach your resume and link your Github/Gitlab profile or any software project you have contributed to (if applicable). \n\n#Salary and compensation\n No salary data published by company so we estimated salary based on similar jobs related to Web3, DevOps, Cloud, Node and Engineer jobs that are similar:\n\n $70,000 — $110,000/year\n
\n\n#Benefits\n 💰 401(k)\n\n🌎 Distributed team\n\n⏰ Async\n\n🤓 Vision insurance\n\n🦷 Dental insurance\n\n🚑 Medical insurance\n\n🏖 Unlimited vacation\n\n🏖 Paid time off\n\n📆 4 day workweek\n\n💰 401k matching\n\n🏔 Company retreats\n\n🏬 Coworking budget\n\n📚 Learning budget\n\n💪 Free gym membership\n\n🧘 Mental wellness budget\n\n🖥 Home office budget\n\n🥧 Pay in crypto\n\n🥸 Pseudonymous\n\n💰 Profit sharing\n\n💰 Equity compensation\n\n⬜️ No whiteboard interview\n\n👀 No monitoring system\n\n🚫 No politics at work\n\n🎅 We hire old (and young)\n\n
\n\n#Location\nVancouver, British Columbia, Canada

\nWe are looking for people willing to work a 10am - 7pm PST schedule or later. This role can be fully remote. \n\nAbout the role:\n\nThe High Performance Computing Operations team is responsible for the day-to-day provisioning, management and uptime of CoreWeave’s ever-expanding fleet of server nodes. Playing a central role in CoreWeave’s growth strategy, this team is on the front line for configuration, updates and remote troubleshooting of our highest tier of supercomputing clusters and their networking, delivery platforms and tools dependencies. You will be in a daily battle with the forces of entropy to maximize the number of nodes CoreWeave can deliver to customers.\n\nWe are seeking curious, creative and persistent problem solvers to join our HPC Operations team to help us drive batches of server nodes through our provisioning and validation processes while efficiently and effectively troubleshooting node or cluster problems as they arise. This individual will join a team of committed engineers working to deploy nodes as fast as they can be racked and turned on. \n\nKey Responsibilities:\n\n\n* Install, configure, and maintain large-scale high-performance supercomputing clusters running state-of-the-art GPUs\n\n* Troubleshoot hardware and software issues; escalate and coordinate as needed with data center, network and platform teams to drive resolution\n\n* Monitor and analyze system performance and take appropriate remediation actions for cloud health\n\n* Approach your work with flexibility and optimism anticipating shifting business and technical priorities\n\n* Create and maintain documentation of team processes, knowledge and best practices for system management\n\n* Think critically about your day-to-day work and work collaboratively to improve team processes and efficiency\n\n\n\n\nSuccessful candidates typically share the following skills and experience:\n\n\n* 2 or more years of experience troubleshooting or administering data center or on-prem infrastructure (servers, storage, network or a mix)\n\n* Strong understanding of Linux system administration and networking concepts\n\n* Ability to troubleshoot hardware and software issues and perform system maintenance tasks consistently and reliably\n\n\n\n\nIdeal candidates may also have experience in one or more of these:\n\n\n* Software development or scripting languages (bash, python, powershell, etc)\n\n* Grafana, prometheus, promsql queries or similar observability platforms\n\n* Data center environments including server racks, HVAC systems, fiber trays\n\n* Kubernetes administration\n\n\n\n\nOur compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $80,000/year in our lowest geographic market up to $110,000/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience.\n\n  \n\n#Salary and compensation\n No salary data published by company so we estimated salary based on similar jobs related to Cloud, Node, Engineer and Linux jobs that are similar:\n\n $52,500 — $95,000/year\n
\n\n#Benefits\n 💰 401(k)\n\n🌎 Distributed team\n\n⏰ Async\n\n🤓 Vision insurance\n\n🦷 Dental insurance\n\n🚑 Medical insurance\n\n🏖 Unlimited vacation\n\n🏖 Paid time off\n\n📆 4 day workweek\n\n💰 401k matching\n\n🏔 Company retreats\n\n🏬 Coworking budget\n\n📚 Learning budget\n\n💪 Free gym membership\n\n🧘 Mental wellness budget\n\n🖥 Home office budget\n\n🥧 Pay in crypto\n\n🥸 Pseudonymous\n\n💰 Profit sharing\n\n💰 Equity compensation\n\n⬜️ No whiteboard interview\n\n👀 No monitoring system\n\n🚫 No politics at work\n\n🎅 We hire old (and young)\n\n
\n\n#Location\nLas Vegas, Nevada, United States

\nThe Opportunity\n\nThe Chan Zuckerberg Biohub Network has an immediate opening for an AI/ML High Performance Computing (HPC) Principal Engineer.  The CZ Biohub Network is composed of several new institutes that the Chan Zuckerberg Initiative created to do great science that cannot be done in conventional environments.  The CZ Biohub Network brings together researchers from across disciplines to pursue audacious, important scientific challenges. The Network consists of four institutes throughout the country; San Francisco, Silicon Valley, Chicago and New York City.  Each institute closely collaborates with the major universities in its local area.  Along with the world-class engineering team at the Chan Zuckerberg Initiative, the CZ Biohub supports several 100 of the brightest, boldest engineers, data scientists, and biomedical researchers in the country, with the mission of understanding the mysteries of the cell and how cells interact within systems.\n\nThe Biohub is expanding its global scientific leadership, particularly in the area of AI/ML, with the acquisition of the largest GPU cluster dedicated to AI for biology. The AI/ML HPC Principal Engineer will be tasked with helping to realize the full potential of this capability in addition to providing advanced computing capabilities and consulting support to science and technical programs. This position will work closely with many different science teams simultaneously to translate experimental descriptions into software and hardware requirements and across all phases of the scientific lifecycle, including data ingest, analysis, management and storage, computation, authentication, tool development and many other computing needs expressed by scientific projects.\n\nThis position reports to the Director for Scientific Computing and will be hired at a level commensurate with the skills, knowledge, and abilities of the successful candidate.\n\nWhat You'll Do\n\n\n* Work with a wide community of scientific disciplinary experts to identify emerging and essential information technology needs and translate those needs into information technology requirements\n\n* Build an on-prem HPC infrastructure supplemented with cloud computing to support the expanding IT needs of the Biohub\n\n* Support the efficiency and effectiveness of capabilities for data ingest, data analysis, data management, data storage, computation, identity management, and many other IT needs expressed by scientific projects\n\n* Plan, organize, track and execute projects\n\n* Foster cross-domain community and knowledge-sharing between science teams with similar IT challenges\n\n* Research, evaluate and implement new technologies on a wide range of scientific compute, storage, networking, and data analytics capabilities\n\n* Promote and assist researchers with the use of Cloud Compute Services (AWS, GCP primarily) containerization tools, etc. to scientific clients and research groups\n\n* Work on problems of diverse scope where analysis of data requires evaluation of identifiable factors\n\n* Assist in cost & schedule estimation for the IT needs of scientists, as part of supporting architecture development and scientific program execution\n\n* Support Machine Learning capability growth at the CZ Biohub\n\n* Provide scientist support in deployment and maintenance of developed tools\n\n* Plan and execute all above responsibilities independently with minimal intervention\n\n\n\n\nWhat You'll Bring \n\nEssential –\n\n\n* Bachelor’s Degree in Biology or Life Sciences is preferred. Degrees in Computer Science, Mathematics, Systems Engineering or a related field or equivalent training/experience also acceptable.\n\n* A minimum of 8 years of experience designing and building web-based working projects using modern languages, tools, and frameworks\n\n* Experience building on-prem HPC infrastructure and capacity planning\n\n* Experience and expertise working on complex issues where analysis of situations or data requires an in-depth evaluation of variable factors\n\n* Experience supporting scientific facilities, and prior knowledge of scientific user needs, program management, data management planning or lab-bench IT needs\n\n* Experience with HPC and cloud computing environments\n\n* Ability to interact with a variety of technical and scientific personnel with varied academic backgrounds\n\n* Strong written and verbal communication skills to present and disseminate scientific software developments at group meetings\n\n* Demonstrated ability to reason clearly about load, latency, bandwidth, performance, reliability, and cost and make sound engineering decisions balancing them\n\n* Demonstrated ability to quickly and creatively implement novel solutions and ideas\n\n\n\n\nTechnical experience includes - \n\n\n* Proven ability to analyze, troubleshoot, and resolve complex problems that arise in the HPC production compute, interconnect, storage hardware, software systems, storage subsystems\n\n* Configuring and administering parallel, network attached storage (Lustre, GPFS on ESS, NFS, Ceph) and storage subsystems (e.g. IBM, NetApp, DataDirect Network, LSI, VAST, etc.)\n\n* Installing, configuring, and maintaining job management tools (such as SLURM, Moab, TORQUE, PBS, etc.) and implementing fairshare, node sharing, backfill etc.. for compute and GPUs\n\n* Red Hat Enterprise Linux, CentOS, or derivatives and Linux services and technologies like dnsmasq, systemd, LDAP, PAM, sssd, OpenSSH, cgroups\n\n* Scripting languages (including Bash, Python, or Perl)\n\n* OpenACC, nvhpc, understanding of cuda driver compatibility issues\n\n* Virtualization (ESXi or KVM/libvirt), containerization (Docker or Singularity), configuration management and automation (tools like xCAT, Puppet, kickstart) and orchestration (Kubernetes, docker-compose, CloudFormation, Terraform.)\n\n* High performance networking technologies (Ethernet and Infiniband) and hardware (Mellanox and Juniper)\n\n* Configuring, installing, tuning and maintaining scientific application software (Modules, SPACK)\n\n* Familiarity with source control tools (Git or SVN)\n\n* Experience with supporting use of popular ML frameworks such as Pytorch, Tensorflow\n\n* Familiarity with cybersecurity tools, methodologies, and best practices for protecting systems used for science\n\n* Experience with movement, storage, backup and archive of large scale data\n\n\n\n\nNice to have - \n\n\n* An advanced degree is strongly desired\n\n\n\n\nThe Chan Zuckerberg Biohub requires all employees, contractors, and interns, regardless of work location or type of role, to provide proof of full COVID-19 vaccination, including a booster vaccine dose, if eligible, by their start date. Those who are unable to get vaccinated or obtain a booster dose because of a disability, or who choose not to be vaccinated due to a sincerely held religious belief, practice, or observance must have an approved exception prior to their start date.\n\nCompensation \n\n\n* $212,000 - $291,500\n\n\n\n\nNew hires are typically hired into the lower portion of the range, enabling employee growth in the range over time. To determine starting pay, we consider multiple job-related factors including a candidate’s skills, education and experience, market demand, business needs, and internal parity. We may also adjust this range in the future based on market data. Your recruiter can share more about the specific pay range during the hiring process. \n\n#Salary and compensation\n No salary data published by company so we estimated salary based on similar jobs related to Consulting, Education, Cloud, Node, Engineer and Linux jobs that are similar:\n\n $57,500 — $85,000/year\n
\n\n#Benefits\n 💰 401(k)\n\n🌎 Distributed team\n\n⏰ Async\n\n🤓 Vision insurance\n\n🦷 Dental insurance\n\n🚑 Medical insurance\n\n🏖 Unlimited vacation\n\n🏖 Paid time off\n\n📆 4 day workweek\n\n💰 401k matching\n\n🏔 Company retreats\n\n🏬 Coworking budget\n\n📚 Learning budget\n\n💪 Free gym membership\n\n🧘 Mental wellness budget\n\n🖥 Home office budget\n\n🥧 Pay in crypto\n\n🥸 Pseudonymous\n\n💰 Profit sharing\n\n💰 Equity compensation\n\n⬜️ No whiteboard interview\n\n👀 No monitoring system\n\n🚫 No politics at work\n\n🎅 We hire old (and young)\n\n
\n\n#Location\nSan Francisco, California, United States