Data Engineer
What Does a Professional in this Career Do?
A Data Engineer designs, builds and manages the information or big data infrastructure. Develops the architecture that helps analyze and process data in the way the organization needs it. Makes sure those systems are performing smoothly.
Job Outlook
There were 1492 Data Engineer job postings in North Carolina in the past year and 39870 in the United States.
In combination with other careers in the Data Engineer industry, which includes the Data Engineer career, the following graph shows the number of people employed for each year since 2015:
Salary
Many new Data Engineer jobs have salaries estimated to be in the following ranges, based on the requirements and responsibilities listed in job postings from the past year.
National
The average estimated salary in the United States for this career, based on job postings in the past year, is $126,509.
State
The average estimated salary in North Carolina for this career, based on job postings in the past year, is $124,502.
Percentiles represent the percentage that is lower than the value. For example, 25% of estimated salaries for Data Engineer postings in the United States in the past year were lower than $111,677.
Education and Experience
Posted Data Engineer jobs typically require the following level of education. The numbers below are based on job postings in the United States from the past year. Not all job postings list education requirements.
Education Level | Percentage |
---|---|
Associate's Degree | 0% |
Bachelor's Degree | 59.35% |
Master's Degree | 21.94% |
Doctoral Degree | 3.46% |
Other | 2.41% |
Posted Data Engineer jobs typically require the following number of years of experience. The numbers below are based on job postings in the United States from the past year. Not all job postings list experience requirements.
Years of Experience | Percentage |
---|---|
0 to 2 years | 12.25% |
3 to 5 years | 52.4% |
6 to 8 years | 22.86% |
9+ years | 12.49% |
Skills
Below are listings of the most common general and specialized skills Data Engineer positions expect applicants to have as well as the most common skills that distinguish individuals from their peers. The percentage of job postings that specifically mention each skill is also listed.
Baseline Skills
A skill that is required across a broad range of occupations, including this one.
- Communication (34.41%)
- Problem Solving (26.06%)
- Management (21.27%)
- Troubleshooting (Problem Solving) (19.26%)
- Operations (14.18%)
- Leadership (13.3%)
- Innovation (12.98%)
- Information Technology (10.89%)
- Research (10.13%)
- Mentorship (9.53%)
Defining Skills
A core skill for this occupation, it occurs frequently in job postings.
- Azure Data Factory (10.18%)
- Informatica (8.12%)
- Apache Airflow (14.07%)
- Amazon Web Services (38.7%)
- Java (Programming Language) (21.68%)
- Data Lakes (14.62%)
- Agile Methodology (26.78%)
- Microsoft Azure (30.09%)
- Big Data (25.8%)
- Apache Hive (9.05%)
- Data Integration (15.52%)
- Python (Programming Language) (65.1%)
- Extract Transform Load (ETL) (49.26%)
- Data Modeling (36.32%)
- Data Engineering (83.96%)
- Data Quality (24.51%)
- Computer Science (45.22%)
- Data Architecture (12.72%)
- Data Warehousing (38.28%)
- Data Analysis (27.58%)
- Apache Hadoop (14.97%)
- Machine Learning (20.56%)
- Scalability (30.78%)
- Data Infrastructure (9.36%)
- Synapse Citrix (3.14%)
- Data Ingestion (9.28%)
- SQL (Programming Language) (66.81%)
- PySpark (11.61%)
- Apache Kafka (15.26%)
- Data Pipelines (42.85%)
- Amazon Redshift (14.14%)
- Apache Spark (29.54%)
- Scala (Programming Language) (16.75%)
- Real Time Data (5.48%)
- Databricks (15.33%)
Necessary Skills
A skill that is requested frequently in this occupation but isn’t specific to it.
- Workflow Management (16.04%)
- Git (Version Control System) (9.87%)
- Google Cloud Platform (GCP) (10.4%)
- Data Processing (14.11%)
- Business Process (4.42%)
- Automation (21.23%)
- Artificial Intelligence (10.44%)
- Amazon S3 (11.62%)
- Algorithms (6.17%)
- Software Development (11.59%)
- Application Programming Interface (API) (16.77%)
- Business Intelligence (19.22%)
- Dashboard (10.46%)
- Business Requirements (13.09%)
- Linux (7.04%)
- Data Governance (15.13%)
- Unix (5.56%)
- Data Visualization (11.63%)
- Information Systems (8.21%)
- Data Management (15.72%)
- Relational Databases (12.65%)
- R (Programming Language) (8.65%)
- Data Security (8.27%)
- Data Structures (8.35%)
- Finance (4.24%)
- DevOps (11.71%)
- Version Control (7.81%)
- PostgreSQL (10.59%)
- MongoDB (5.85%)
- MySQL (7.81%)
- Code Review (6.14%)
- Relational Database Management Systems (5.42%)
- NoSQL (13.86%)
- Software Engineering (13.4%)
- Scrum (Software Development) (7.58%)
- Project Management (8.8%)
- Microsoft SQL Servers (6.81%)
- SQL Server Integration Services (SSIS) (6.82%)
- Programming Languages (12.65%)
- Power BI (14.76%)
- CI/CD (15.93%)
- Data Science (19.68%)
- Tableau (Business Intelligence Software) (14.51%)
- Jenkins (6.14%)
- Kubernetes (7.88%)
- Advanced Analytics (4.03%)
- Docker (Software) (7.36%)
- Microservices (5.42%)
- Scripting (14.38%)
- Terraform (6.37%)
Distinguishing Skills
A skill that may distinguish a subset of the occupation.
- AWS Kinesis (3.65%)
- Google Cloud Dataproc (1.64%)
- Azure Data Lake (3.02%)
- AWS Glue (4.03%)
- Azure Databricks (3.83%)
- Data Transformation (7.03%)
- BigQuery (5.7%)
- Distributed Data Store (3.32%)
- MapReduce (2.3%)
- Hadoop Distributed File System (HDFS) (2.57%)
- Unstructured Data (6.67%)
- Data Storage (7.53%)
- Transact-SQL (4.17%)
- Apache Cassandra (3.68%)
Salary Boosting Skills
A professional who wishes to excel in this career path may consider developing the following highly valued skills. The percentage of job postings that specifically mention each skill is listed.
- AWS Kinesis (4.3%)
- Google Cloud Dataproc (1.93%)
- DataOps (4.11%)
- Apache Airflow (16.55%)
- AWS Glue (4.74%)
- Data Analysis (32.43%)
- Microsoft Azure (35.37%)
- BigQuery (6.7%)
- Computer Science (53.16%)
- Data Infrastructure (11.01%)
- Data Store (6.58%)
- Distributed Data Store (3.91%)
- Apache Hadoop (17.6%)
- Apache Hive (10.63%)
- Scala (Programming Language) (19.7%)
- Apache Spark (34.73%)
- Real Time Data (6.44%)
- Databricks (18.02%)
- Amazon Redshift (16.62%)
Alternative Job Titles
Sometimes employers post jobs with Data Engineer skills but a different job title. Some common alternative job titles include:
- Lead Data Engineer
- Database Engineer
- Azure Engineer
- Big Data Engineer
- Analytics Engineer
- Principal Engineer
- Staff Data Engineer
- Data Integration Engineer
- Manager/Data Engineer
Similar Occupations
If you are interested in exploring occupations with similar skills, you may want to research the following job titles. Note that we only list occupations that have at least one corresponding NC State Online and Distance Education program.
- ETL Developer
- Data Warehouse Developer
- Database Architect
- Database Analyst / Developer
- Data Manager
- Business Intelligence Developer / Architect
- SQL Developer
Common Employers
Here are the employers that have posted the most Data Engineer jobs in the past year along with how many they have posted.
United States
- Insight Global (591)
- Amazon (590)
- Ford (490)
- Randstad (400)
- Kforce (397)
- Motion Recruitment (394)
- Capital One (381)
- Robert Half (354)
- Beacon Hill Staffing Group (328)
- The Judge Group (298)
North Carolina
- Randstad (68)
- Insight Global (29)
- Kforce (22)
- Fidelity Investments (21)
- Motion Recruitment (21)
- Robert Half (21)
- Infosys (19)
- Jobot (19)
- Eliassen Group (18)
- The Hartford (18)
NC State Programs Relevant to this Career
If you are interested in preparing for a career in this field, the following NC State Online and Distance Education programs offer a great place to start!
- Agriculture Data Science Graduate Certificates
- Data Science Foundations Graduate Certificates
- Foundations of Data Science Master's Degrees
- Statistics Master's Degrees
All wages, job posting statistics, employment trend projections, and information about skill desirability on this page represents historical data and does not guarantee future conditions. Data is provided by and downloaded regularly from Lightcast. For more information about how Lightcast gathers data and what it represents, see Lightcast Data: Basic Overview on Lightcast's Knowledge Base website.