February 29, 2024

We are creating some awesome events for you. Kindly bear with us.

Researchers find large ‘hidden’ job market for PhD graduates in Australia by using machine learning to scan job ads

Researchers find large ‘hidden’ job market for PhD graduates in Australia by using machine learning to scan job ads

Researchers from the Australian National University (ANU)
and the Commonwealth Scientific and Industrial Research Organisation’s (CSIRO)
Data61 have found
a large hidden job market for PhD graduates
by using machine learning to
scan tens of thousands of job ads.

This project
set out to produce data and methods to help universities prepare graduates for
workplaces outside academia, and also help industry to recognise the value of
the research skills developed by graduates of PhD and MPhil programs.

The project successfully used Machine Learning to analyse
job ads in order to better understand Australian industry demand for highly
skilled researchers. Though further research and development work is required, the
machine developed in this project can be used to perform a longitudinal
examination of Australian industry response to the innovation agenda.

The project was funded by the Australian Government
Department of Industry, Innovation and Science, and the job-search company, SEEK
Limited, provided raw data.

This interdisciplinary project was based on a strategic
partnership across governmental, industrial, and academic sectors. The research
team had expertise in computer science, research education, linguistics and
social science.

The challenge

The PhD was originally designed to train academics, but it
is now more common for PhD graduates to leave the higher education sector than
to go on to an academic career. The project report highlights this as a
positive development. Highly skilled researchers working in a wider variety of
industry sectors can drive future economic prosperity, as PhD students can be
the vehicles for enhanced collaboration and knowledge transfer between academia
and industry.

But Australia stands out amongst most developed countries
for lack of interest displayed by non-academic employers’ towards PhD
graduates, the report notes. In this area, Australia is significantly behind
similar countries on the World Economic Forum competitiveness index.

The report says that PhD programs still tend to privilege
skills required for an academic career over those required by industry. From
the supply side, Australian universities must do more to prepare PhD graduates
for a wider range of workplaces. This will involve changes to the form and
content of PhD curriculum, in addition additional co-curricular opportunities. From
the demand side, there is a lack of awareness of what skills and capabilities
people develop during the PhD and perhaps a lack of trust in the qualification
as producing ‘work ready’ employees.

Actionable data insights

Government can help by setting policy and creating
incentives, but the data to inform this work was incomplete and not actionable.
Data from the Australian Bureau of Statistics (ABS) and the Graduate
Destination Survey (GDS) shows the uptake of graduates in the business
community, but they are both lagging indicators. Future-focused information was
required to target policy and education efforts appropriately.

In this project, the team addressed this need for complete,
actionable data with a ‘big data’ approach, by applying Machine Learning (ML)
and Natural Language Processing (NLP), sometimes referred to as ‘Text (Data)
Mining’, to analyse 29,693 authentic job ads.

The report describes a job ad as a pitch to a potential
applicant which outlines the type of work that is required and the type of
person that the employer would like to hire. If employers do not use “PhD” as a
keyword in a job ad, a simple keyword search will not retrieve all ads aimed at
PhD graduates.

This project sought to design a ML-based NLP algorithm that
could learn what a ‘PhD shaped job’ looks like; highlight these within a large,
complex dataset supplied by SEEK and enable interactive search and
visualisation of this information as a web demonstration system. In addition, the
team aimed to teach the machine to analyse the job ad and find out what skills
and capabilities were most important to employers.

The results and applications

The machine found a large ‘hidden job market’ for PhD
graduates in the Australian workforce.

Only 20.7 per cent of non-academic job ads (2,770 of 13,379
unique job titles) in the dataset asked for a PhD qualification, yet as many as
43 per cent (210 of 483) of the unique job ads that were analysed (as part of the hand coding carried out during this project by two content experts) required a
high level of research skills and capabilities, indicative of a PhD. Building on this, the machine read 29,693 job
advertisements, predicting 15,440 ads (52%), 10,689 ads
(36%), and 3,564 ads (11%) as having a High, Medium, and
Low Knowledge Intensity Bandwidth, respectively.

While this dataset does not encompass the full extent of the
Australian employment landscape (ads of this dataset appeared to skew towards
managerial and professional jobs) it does reflect a dramatic gulf in Australian
perceptions of the PhD.

The team is proposing that the machine could be refined and
used to track changes in industry demand for Australia’s higher degree research
qualified workforce over a five-year period in order to see if this approach is
useful as a benchmarking process.

Supplied with up to the minute job data sources, the machine
could provide real time details on demand for higher degree knowledge workers
usable in policy development. Policy makers could use the machine to perform
fine-grained analyses of demand for skilled researchers in a given industry
sector, target further analysis of the specific researcher skill sets required
by various industries; and measure the alignment between employer demand and
targeted funding initiatives in the area of research training, enabling more
forensic targeting of initiatives such as scholarships, internships, and
industry incentive packages.

The machine could enable targeted studies to inform policy
interventions to drive innovation, particularly in regional areas and
industries with currently low levels of demand for highly skilled workers.

Moreover, the methodology could be adapted to make machines
that will enable the analysis of prospects for other cohorts in higher
education, such as undergraduate and Masters degrees.

Using the machine with the current dataset, research
education experts and statisticians could produce data to inform evidence based
curriculum audits to explore how teaching and learning activities align with
current industry demand and identify emerging trends in demand for research
skills to inform course design.

One of the lead researchers, Dr. Will Grant from ANU, said, “We
taught the machine to analyse job ads and tell us what skills were most
important to employers. The problem is that industry employers in Australia –
particularly in manufacturing, transport, logistics, marketing and
communication – may not be aware that PhD graduates have the skill set they're
looking for.”

Co-researcher Adjunct Professor Hanna Suominen, a natural
language processing expert from CSIRO's Data61, co-invented the machine
learning algorithm and is optimistic about the potential of this tool to help
find work for PhD students.

“Our researchers will continue to develop the machine into a
web portal to support PhD graduates in their search for work. It has the
potential to connect PhD graduates with ideal jobs they may not have otherwise
come across or considered,” Dr. Suominen said.

Read the project report here.


Qlik’s vision is a data-literate world, where everyone can use data and analytics to improve decision-making and solve their most challenging problems. A private company, Qlik offers real-time data integration and analytics solutions, powered by Qlik Cloud, to close the gaps between data, insights and action. By transforming data into Active Intelligence, businesses can drive better decisions, improve revenue and profitability, and optimize customer relationships. Qlik serves more than 38,000 active customers in over 100 countries.


CTC Global Singapore, a premier end-to-end IT solutions provider, is a fully owned subsidiary of ITOCHU Techno-Solutions Corporation (CTC) and ITOCHU Corporation.

Since 1972, CTC has established itself as one of the country’s top IT solutions providers. With 50 years of experience, headed by an experienced management team and staffed by over 200 qualified IT professionals, we support organizations with integrated IT solutions expertise in Autonomous IT, Cyber Security, Digital Transformation, Enterprise Cloud Infrastructure, Workplace Modernization and Professional Services.

Well-known for our strengths in system integration and consultation, CTC Global proves to be the preferred IT outsourcing destination for organizations all over Singapore today.


Planview has one mission: to build the future of connected work. Our solutions enable organizations to connect the business from ideas to impact, empowering companies to accelerate the achievement of what matters most. Planview’s full spectrum of Portfolio Management and Work Management solutions creates an organizational focus on the strategic outcomes that matter and empowers teams to deliver their best work, no matter how they work. The comprehensive Planview platform and enterprise success model enables customers to deliver innovative, competitive products, services, and customer experiences. Headquartered in Austin, Texas, with locations around the world, Planview has more than 1,300 employees supporting 4,500 customers and 2.6 million users worldwide. For more information, visit www.planview.com.


SIRIM is a premier industrial research and technology organisation in Malaysia, wholly-owned by the Minister​ of Finance Incorporated. With over forty years of experience and expertise, SIRIM is mandated as the machinery for research and technology development, and the national champion of quality. SIRIM has always played a major role in the development of the country’s private sector. By tapping into our expertise and knowledge base, we focus on developing new technologies and improvements in the manufacturing, technology and services sectors. We nurture Small Medium Enterprises (SME) growth with solutions for technology penetration and upgrading, making it an ideal technology partner for SMEs.


HashiCorp provides infrastructure automation software for multi-cloud environments, enabling enterprises to unlock a common cloud operating model to provision, secure, connect, and run any application on any infrastructure. HashiCorp tools allow organizations to deliver applications faster by helping enterprises transition from manual processes and ITIL practices to self-service automation and DevOps practices. 


IBM is a leading global hybrid cloud and AI, and business services provider. We help clients in more than 175 countries capitalize on insights from their data, streamline business processes, reduce costs and gain the competitive edge in their industries. Nearly 3,000 government and corporate entities in critical infrastructure areas such as financial services, telecommunications and healthcare rely on IBM’s hybrid cloud platform and Red Hat OpenShift to affect their digital transformations quickly, efficiently and securely. IBM’s breakthrough innovations in AI, quantum computing, industry-specific cloud solutions and business services deliver open and flexible options to our clients. All of this is backed by IBM’s legendary commitment to trust, transparency, responsibility, inclusivity and service.

Send this to a friend