Data Engineer

Company: HIRED
Location: Milpitas
Posted on: April 1, 2021

Job Description:

Join Hired and find your dream job as a Data Engineer at one of 10,000+ companies looking for candidates just like you.Companies on Hired apply to you, not the other way around. With demand for Data Engineers increasing rapidly, your skills and experience can quickly get you in front of companies hiring right now. With Hired, you'll receive salary and compensation details up front - before the interview - and find a job you'll love quickly.Data Engineers will be responsible for developing data solutions on top of existing database structures and implementing streaming capabilities which relate to every other source of data in a system. You will be involved in each step of engineering databases and processing systems, meaning you must have a firm foundation in common data language and its related tools. Although other teams that take that data and make it tell a story, without Data Engineers, the architecture would not be available to collect, store and utilize that important data.Responsibilities* The creation and maintenance of large-scale data structures that help users generate, store and manage big data.* The development of tests that allow for the data warehouses to be deemed reliable.* The design and deployment of more sound data architecture to replace faulty structures.* Communicating with team members and other colleagues and managers progress on big data structures using the proper verbiage per audience.* Keeping business needs in mind when collaborating on and designing data structures.* Using cutting-edge technologies and common scripting languages.Skills* Experience building and optimizing big data data pipelines, architectures and data sets.* 4+ years of hands-on experience working in data warehousing, data architecture and/or data engineering environments at an enterprise scale.* 4+ years of SQL, MySQL, No-SQL, AWS Redshift, Hive, Snowflake development experience.* 4+ years of experience with schema design and dimensional data modeling.* 3+ years of Python, Ruby, Pandas, Django, NumPy programming experience.* 3+ years working experience on Map Reduce, Big-Data processing frameworks.* Experience in custom or structured (ie. Informatica/Talend/Pentaho/Fivetran) ETL design, implementation and maintenance.* Strong experience writing complex SQL queries.* Experience implementing operational best practices such as monitoring, alerting, metadata management.These Would Also Be Nice* Excellent written and verbal communication skills.* Understanding business needs while being client focused.* Going the distance to make projects a success.* A willingness to take on new responsibilities.* Eager to get their hands on new technologies. Associated topics: data administrator, data analytic, data center, data integration, data management, data scientist, data warehousing, hbase, sql, sybase

Keywords: HIRED, Milpitas , Data Engineer, Engineering , Milpitas, California