Location: San Antonio, TX
Pay: $90,000.00 - $110,000.00 /Year
Ref ID: 04080-0011261335
Classification: Data Modeler
Compensation: $90000.00 to $110000.00 yearly
One of our top clients in the San Antonio area has a new, exciting direct hire opportunity! They are looking for a Data Engineer to expand and optimize their data, data pipeline architecture, data flow and collection for the cross functional teams. Ideally, they are looking for a candidate that enjoys enhancing data systems, building them from the ground up. They will ultimately be supporting the software developers, database architects, data analysts and data scientists on data initiatives, ensuring data delivery architecture is consistent throughout projects.
Responsibilities: - Create and maintain data pipeline architecture - Create large, complex data sets that meet functional/non-functional business requirements - Identify, design, and implement internal processes by automating manual processes, optimizing data delivery, and re-designing infrastructure - Build the infrastructure for ETL of data from various data sources using SQL and Azure 'Big Data' technologies. - Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics. - Work with the executive, product, data and design teams to assist with data-related technical issues and data infrastructure needs. - Keep company data separated/secure across national boundaries, using different data centers and AWS/Azure regions. - Create data tools for analytics and data scientist team members, which will assist in building and optimizing our products. - Work with data and analytics experts in continuously improve functionality in our data systems. Requirements: - 5+ years of experience in a Data Engineer role, who has attained a degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. - Certifications in Azure/AWS, plus experience could comparable - Knowledge/experience in SQL and experience working with relational DBs, query authoring (SQL), etc. - Experience in building and optimizing 'Big Data' data pipelines, architectures and data sets. - Experience in root cause analysis with internal/external data, with the ability to answer specific business questions and identify opportunities for improvement. - Strong analytic skills in working with unstructured datasets. - Build processes supporting data transformation, data structures, metadata, dependency and workload management. - Proven experience in manipulating, processing and extracting value from large disconnected datasets. - Proven experience and knowledge in message queuing, stream processing, and highly scalable 'Big Data' data stores. - Strong project management and organizational skills. - Experience supporting and working with cross-functional teams - Experience using the following software/tools: - Big data tools: Hadoop, Spark, Kafka, etc. - Relational SQL and NoSQL databases - Data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. - AWS/Azure cloud services: EC2, EMR, RDS, Redshift - Stream-processing systems: Storm, Spark-Streaming, etc. - Scripting languages: Python, Java, C++, Scala, SQL, Ruby Preferred Qualifications: - Understanding and implementation experience in cloud data platform technologies such as Microsoft Azure, Amazon Web Services and data lakes. - Experience in one or more of the following areas: Database architecture, Big Data, Machine Learning, Business Intelligence, Data Governance, No-SQL databases, Advanced Analytics, Data Mining, ETL. - Understanding of data profiling and data technology & architecture.
Technology doesn't change the world. People do.
As a technology staffing firm, we can't think of a more fitting mantra. We're extreme believers in technology and the incredible things it can do. But we know that behind every smart piece of software, every powerful processor, and every brilliant line of code is an even more brilliant person.
Leader among IT staffing agencies
The intersection of technology and people — it's where we live. Backed by more than 65 years of experience, Robert Half Technology is a leader among IT staffing agencies. Whether you're looking to hire experienced technology talent or find the best technology jobs, we are your IT expert to call.
We understand not only the art of matching people, but also the science of technology. We use a proprietary matching tool that helps our staffing professionals connect just the right person to just the right job. And our network of industry connections and strategic partners remains unmatched.
Apply for this job now or contact our branch office at 888-490-4429 to learn more about this position.
All applicants applying for U.S. job openings must be authorized to work in the United States. All applicants applying for Canadian job openings must be authorized to work in Canada.
© 2019 Robert Half Technology. An Equal Opportunity Employer M/F/Disability/Veterans.