Data Engineer
What Does a Professional in this Career Do?
A Data Engineer designs, builds and manages the information or big data infrastructure. Develops the architecture that helps analyze and process data in the way the organization needs it. Makes sure those systems are performing smoothly.
Job Outlook
There were 1410 Data Engineer job postings in North Carolina in the past year and 38484 in the United States.
In combination with other careers in the Data Engineer industry, which includes the Data Engineer career, the following graph shows the number of people employed for each year since 2016:
Salary
Many new Data Engineer jobs have salaries estimated to be in the following ranges, based on the requirements and responsibilities listed in job postings from the past year.
National
The average estimated salary in the United States for this career, based on job postings in the past year, is $115,557.
State
The average estimated salary in North Carolina for this career, based on job postings in the past year, is $115,048.
Percentiles represent the percentage that is lower than the value. For example, 25% of estimated salaries for Data Engineer postings in the United States in the past year were lower than $100,903.
Education and Experience
Posted Data Engineer jobs typically require the following level of education. The numbers below are based on job postings in the United States from the past year. Not all job postings list education requirements.
| Education Level | Percentage |
|---|---|
| Associate's Degree | 0% |
| Bachelor's Degree | 57.83% |
| Master's Degree | 22.42% |
| Doctoral Degree | 3.05% |
| Other | 1.99% |
Posted Data Engineer jobs typically require the following number of years of experience. The numbers below are based on job postings in the United States from the past year. Not all job postings list experience requirements.
| Years of Experience | Percentage |
|---|---|
| 0 to 2 years | 11.46% |
| 3 to 5 years | 51.99% |
| 6 to 8 years | 22.44% |
| 9+ years | 14.11% |
Skills
Below are listings of the most common general and specialized skills Data Engineer positions expect applicants to have as well as the most common skills that distinguish individuals from their peers. The percentage of job postings that specifically mention each skill is also listed.
Baseline Skills
A skill that is required across a broad range of occupations, including this one.
- Communication (34.47%)
- Problem Solving (28.42%)
- Troubleshooting (Problem Solving) (21.05%)
- Management (20.41%)
- Innovation (14.37%)
- Operations (13.76%)
- Leadership (13.6%)
- Information Technology (11.33%)
- Mentorship (10.36%)
- Detail Oriented (10.19%)
Defining Skills
A core skill for this occupation, it occurs frequently in job postings.
- Data Pipelines (51.49%)
- Amazon Redshift (15.4%)
- Databricks (20.74%)
- PySpark (13.04%)
- Data Ingestion (11.46%)
- Apache Spark (32.55%)
- Unstructured Data (8.1%)
- SQL (Programming Language) (69.66%)
- Scala (Programming Language) (17.65%)
- Machine Learning (20.89%)
- Python (Programming Language) (68.06%)
- Apache Hadoop (16%)
- Apache Hive (10.11%)
- Scalability (39.09%)
- Data Warehousing (40.92%)
- Data Engineering (91.76%)
- Data Infrastructure (11.75%)
- Extract Transform Load (ETL) (55.75%)
- Data Transformation (7.67%)
- Data Modeling (39.99%)
- Data Quality (29.85%)
- Computer Science (44.28%)
- Automation (22.6%)
- Microsoft Azure (33.5%)
- Big Data (27.67%)
- Amazon Web Services (40.06%)
- Data Analysis (26.36%)
- Agile Methodology (27.96%)
- Snowflake (Data Warehouse) (23.73%)
- Apache Airflow (16.35%)
- Azure Data Factory (12.38%)
- Informatica (8.22%)
- Data Lakes (16.36%)
Necessary Skills
A skill that is requested frequently in this occupation but isn’t specific to it.
- Programming Languages (13.08%)
- CI/CD (18.79%)
- Terraform (6.93%)
- Docker (Software) (7.03%)
- Jenkins (6.02%)
- Apache Kafka (17.8%)
- Kubernetes (7.83%)
- Data Storage (8.86%)
- Data Science (19.31%)
- Scripting (15.15%)
- Process Improvement (6.24%)
- Tableau (Business Intelligence Software) (14.4%)
- Software Engineering (13.13%)
- Statistics (6.77%)
- Power BI (15.89%)
- Scrum (Software Development) (7.72%)
- NoSQL (15.23%)
- Project Management (8.68%)
- PostgreSQL (10.17%)
- Github (7.48%)
- R (Programming Language) (8.61%)
- Data Visualization (12.36%)
- Relational Databases (13.07%)
- DevOps (12.14%)
- Data Architecture (15.34%)
- Dataflow (6.06%)
- Data Governance (19.44%)
- Data Integration (17.91%)
- Data Integrity (8.07%)
- Data Management (15.55%)
- Data Security (10.45%)
- Data Structures (8.27%)
- Information Systems (8.84%)
- Data Processing (17.87%)
- Version Control (10.03%)
- Code Review (6.96%)
- Dashboard (11.8%)
- Business Requirements (14.06%)
- Business Intelligence (20.59%)
- Software Development (10.28%)
- Application Programming Interface (API) (17.4%)
- Artificial Intelligence (11.58%)
- Java (Programming Language) (19.13%)
- Google Cloud Platform (GCP) (10.94%)
- Workflow Management (21.83%)
- Git (Version Control System) (10.97%)
Distinguishing Skills
A skill that may distinguish a subset of the occupation.
- Azure Synapse Analytics (4.9%)
- DataOps (3.65%)
- Real Time Data (6.63%)
- Apache Flink (3.01%)
- Synapse Citrix (3.12%)
- Talend (3.14%)
- SQL Server Integration Services (SSIS) (6.99%)
- Query Optimization (2.95%)
- Distributed Data Store (4.13%)
- Google BigQuery (6.56%)
- Azure Databricks (4.6%)
- AWS Glue (5.41%)
- AWS Kinesis (4.02%)
- Azure Data Lake (4.29%)
Salary Boosting Skills
A professional who wishes to excel in this career path may consider developing the following highly valued skills. The percentage of job postings that specifically mention each skill is listed.
- Informatica (9.63%)
- AWS Kinesis (4.72%)
- Big Data (32.43%)
- Computer Science (51.91%)
- Apache Hive (11.85%)
- Python (Programming Language) (79.78%)
- Apache Spark (38.16%)
- PySpark (15.29%)
- Apache Flink (3.52%)
Alternative Job Titles
Sometimes employers post jobs with Data Engineer skills but a different job title. Some common alternative job titles include:
- Lead Data Engineer
- Manager/Data Engineer
- Azure Engineer
- Big Data Engineer
- Staff Data Engineer
- Principal Engineer
- Analytics Engineer
- Business Intelligence Engineer
- Data Engineering Intern
Similar Occupations
If you are interested in exploring occupations with similar skills, you may want to research the following job titles. Note that we only list occupations that have at least one corresponding NC State Online and Distance Education program.
- ETL Developer
- Data Warehouse Developer
- Data Manager
- Business Intelligence Developer / Architect
- Data Analyst
- Database Architect
- Database Analyst / Developer
Common Employers
Here are the employers that have posted the most Data Engineer jobs in the past year along with how many they have posted.
United States
- Amazon (911)
- Insight Global (639)
- GovCIO (452)
- Capital One (446)
- Cognizant Technology Solutions (434)
- Robert Half (418)
- Eliassen Group (377)
- Motion Recruitment (336)
- Beacon Hill Staffing Group (319)
- Randstad (319)
North Carolina
- Randstad (48)
- The Hartford (29)
- Truist Financial (24)
- Genesis10 (22)
- Kforce (21)
- Lowe's (19)
- Infosys (18)
- Insight Global (18)
- Motion Recruitment (18)
- ManpowerGroup (18)
NC State Programs Relevant to this Career
If you are interested in preparing for a career in this field, the following NC State Online and Distance Education programs offer a great place to start!
- Agriculture Data Science Graduate Certificates
- Data Science Foundations Graduate Certificates
- Foundations of Data Science Master's Degrees
- Statistics Master's Degrees
All wages, job posting statistics, employment trend projections, and information about skill desirability on this page represents historical data and does not guarantee future conditions. Data is provided by and downloaded regularly from Lightcast. For more information about how Lightcast gathers data and what it represents, see Lightcast Data: Basic Overview on Lightcast's Knowledge Base website.