Data Engineer

Responsibilities

• Build and operate data infrastructure: storage, container orchestration, database management, and real-time data ingestion systems.
• Optimize Data systems for scale, speed, and reliability.
• Design and build services for end-to-end data security and data governance: managing access controls across multiple storage and access layers, tracking data quality, cataloging datasets and their lineage, usage auditing.
• Build and evolve the tools that empower colleagues across the company to access data and build reliable and scalable transformations. This includes UIs and simple frameworks for derived tables and dimensional modeling, APIs and caching layers for high-throughput serving, and SDKs.
• Build systems that secure and govern our data end to end: control access across multiple storage and access layers (including BI tools), track data quality, catalogue datasets and their lineage, detect duplication, audit usage and ensure correct data semantics.

Requirements

• Experience building backend data systems at scale with parallel/distributed compute.
• Expert at SQL and SQL database design
• Experience using data tools and orchestration frameworks such as Kubeflow, Airflow, Spark, Flink, Hadoop, Presto, Hive, or Kafka.
• Comfortable writing production quality code in languages such as Python, GoLang, Rust
• Experience working with public cloud infrastructure providers such as GCP

About

Gauntlet’s mission is to help make blockchain protocols and smart contracts safer and more trustworthy for users. Building decentralized systems creates new challenges for protocol developers, smart contract developers, and asset holders that are not seen in traditional development and investing. Gauntlet is building a blockchain simulation and testing platform that leverages battle-tested techniques from other industries to emulate interactions in crypto networks. Simulation provides transparency and greatly reduces the cost of experimentation so that teams can rapidly design, launch, and scale new decentralized systems.

Our goal is to make building an agent-based simulation for blockchains and smart contracts as streamlined as possible. At the core of our infrastructure stack is a blazing fast C++ engine that allows us to simulate protocols, contracts, and network interactions millions of times faster than they run in reality.