Data Engineer (Global - Hybrid/Remote)
We are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our software developers, database architects, data analysts, and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives.
Responsibilities:
- Create and maintain optimal data pipeline architecture in a secure, well-tested, and performant way.
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
- Collaborate with Product Management and other stakeholders within Engineering (Frontend, UX, Data science, etc.) to maintain a high bar for quality in a fast-paced, environment.
- Craft code that meets our internal standards for style, maintainability, and best practices for a high-scale environment.
- Recognize impediments to our efficiency as a team ("technical debt"), propose and implement solutions
- Collaborate with the team on larger projects.
- Participate in Tier 2 or Tier 3 weekday and weekend and occasional night on-call rotations to assist in troubleshooting product operations, security operations, and urgent engineering issues.
Requirements:
- At least 4 years of experience with big data tools: Hadoop, Spark, Kafka, etc.
- Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
- Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
- Experience with stream-processing systems: Storm, Spark-Streaming, etc.
- Professional experience with any other technologies that may be required by the project, fx: Java, JavaScript, GoLang, Python, Rust, Protbuf, etc.
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Professional experience with message queuing patterns and concepts.
- Proficiency in the English language, both written and verbal
- Experience owning a project from concept to production, including proposal, discussion, and execution.
- Comfort and familiarity with the code review process.
- Comfort working in a highly agile, intensely fast pace engineering organization.
- An inclination towards communication, inclusion, and visibility.
- Positive and solution-oriented mindset.
- Ability to thrive in a fully remote organization
Join AXON Networks!
www.axon-networks.com
Apply NOW by sending your updated CV to
hr@axon-networks.com
AXON Networks delivers a robust AI-driven, analytics-based orchestration platform and a wide portfolio of next-gen high-speed routers that leverage the newest Wi-Fi technologies. Together, these technologies give ISPs the ability to manage and troubleshoot their networks in real time, and to deliver an outstanding customer experience.
AXON Networks is a trusted strategic partner for its customers, helping them evaluate their current technologies and business models, and creating and executing strategies that enable them to innovate faster, accelerate their digital transformations, and strengthen their relationships with consumers.
AXON Networks is headquartered in Irvine, CA USA with Asia HQ in Singapore and also operating in Denmark and Vietnam.