Senior Big Data Engineer
Our Direct Client is seeking an experienced, full-time, on-site, dedicated Candidate, with skills and expertise as described in below requirement.
As a Senior Data Engineer, you will help design, enhance and build solutions dealing with real-time data in a fast-paced environment working with/on cutting-edge data and cloud technologies. You will work with colleagues who will support and challenge you daily. We believe in self-managing Agile teams who build products end to end, focusing on unit testing, code reviews and continuous integration for excellent code quality.
The ideal Senior Data Engineer is a collaborative leader skilled in designing and constructing highly scalable data focused applications. You are committed to data automation and integrity, are highly analytical, and can work on multiple projects at once. You will use your skills to engineer, automate, and manage data systems across multiple cloud services platforms and toolsets. Additionally, you will act as a mentor to junior team members and coach them on best practices and engineering standards. The team culture of working collaboratively, cross-functionally, using new technologies combined with the work/life balance provided by Client are core reasons people enjoy working as part of the Data Division.
Required Skills and Experience:
Required 8 years - Experience in large-scale IT Project/Product delivery with at least 3 years of work experience in current data streaming, messaging, management, and database technologies
Required 8 years - Ability to establish and always maintain effective and professional working relationships with others in the course and scope of conducting business
Required 8 years - Excellent communication, problem-solving, and organizational skills
Required 5 years - Strong data integrity, analytical, and multitasking skills
Preferred 4 years - Graduation from an accredited four-year college or university with major coursework in Computer Science or Engineering
Preferred 3 years - Experience creating producer and consumer applications with Kafka
Preferred 2 years - Experience with designing and building data platforms
Preferred 2 years - Experience in tuning and troubleshooting streaming/messaging platforms
Preferred 2 years - Experience coding and scripting (Python, Java, Scala) and design experience
Preferred 2 years - Experience with ELT methodologies and tools
Preferred 2 years - Hands-on experience with AWS and/or Azure
Preferred 2 years - Experience with KStreams and KSQL
Preferred 2 years - Experience with designing and automating build and deployment solutions/process for data solutions
Preferred 2 years - Familiarity with data visualization, warehouse, and analytics tools/platforms such as Qlick, SAS Viya, Kibana, Snowflake
Preferred 2 years - Experience with streaming/messaging platforms (Kafka, MQ, RabbitMQ, Elk, Elasticsearch)
Preferred 1 years - Basic knowledge of database technologies (PostgreSQL, Vertica, Redshift, etc.)
Preferred 1 years - Able to work independently