Research Director, Measurement and Methodology

Position overview

The Research Director, Methodology and Measurement leads ACER’s work in the development and application of psychometric, statistical and sampling models. The unit includes ACER’s Psychometrics team and ACER’s Sampling team. This program will create new and support existing technical design and analysis approaches across a diverse and high-profile range of assessments and educational data sets.  

Major activities of the unit staff include: scale construction research and quality assurance; development and implementation of applied measurement and statistical modelling techniques in operational projects; analysis and modelling of process data from interactive digital assessments; optimization of adaptive and form assembly algorithms; design and analysis of causal inference and longitudinal studies; calculation of power analyses and sample size estimates; implementation of applied sampling designs, survey analytic and imputation techniques, and sampling weights.

The unit will also collaborate closely with colleagues in the Data Science and Automation program to operationalise new workflows and new methods at the intersection of psychometrics, computer science and Artificial Intelligence. 

Responsibilities also include execution of research to extend existing and create novel models; extension of analytic techniques for missing data structures in survey samples; development and dissemination of materials on use of complex datasets and interpretation of methods and results for technical or lay audiences; and leading business development and external activities for psychometrics, sampling and other statistical methodology projects. 

Position context

The Australian Council for Educational Research is an independent, not-for-profit educational research and development organisation. Approximately 460 staff work for the ACER Group in Australia, India, Malaysia, the United Arab Emirates and the United Kingdom. 

The Measurement, Analytics and Technologies (MAT) Division is a key driver of ACER’s innovation in assessment science and data-driven solutions. It comprises two research programs:

• Methodology & Measurement 
• Data Science & Automation 

The Data Science & Automation program is designed to modernise ACER’s data infrastructure and analytical workflows. It will lead the development of algorithmic and AI-driven automation across assessment design, analysis, quality assurance, and reporting. This program will collaborate closely with subject-matter and technology experts, including from Methodology and Measurement and ACER’s IT team, to build advanced statistical tools, new data products, and actionable insights. The Methodology & Measurement program focuses on advancing ACER’s capabilities in psychometric and statistical analysis, complex sampling, and quantitative research methods. It plays a critical role in maintaining ACER’s competitive edge by ensuring methodological rigour and fostering innovation in emerging areas such as computational psychometrics. 

MAT supports both internal and external clients, delivering solutions that span the full learner lifecycle—from early childhood through to adult and professional education. The division’s work underpins ACER’s commitment to evidence-based assessment, innovation, and data-driven educational improvement.   

ACER is committed to the professional growth of staff throughout their employment. It encourages and supports staff in a variety of ways to actively pursue professional learning, including with reference to the ACER Leadership Development Framework. ACER encourages all staff to consider ways in which they might make a leadership contribution to ACER's work. 

Job responsibilities

The Research Director, Methodology and Measurement has the general responsibilities of an ACER Head of Unit and will provide direction and oversight to the teams reporting into this position. This includes setting strategic directions, extending existing and creating novel statistical and psychometrics methods, collaborating with internal and external clients, managing complex projects, monitoring the quality of work, advancing personal expertise, communicating project outcomes, and promoting the organization's public profile. 
 
Professional Expertise

• setting strategic directions for the future work of the department and helping clarify and communicate (internally and externally) a vision for this area of ACER’s work  
• extending existing and creating novel psychometric, statistical, and sampling models as well as designing the analytic approaches to implement them  
• collaborating with internal and external clients to effectively support ongoing projects and existing ACER assessment products  
• leading the implementation of best practices in psychometric and statistical methodologies within the unit  
• leading and managing large, complex and high-quality research or operational projects which deliver to agreed objectives, standards, timelines and budgets  
• monitoring the quality of the unit’s work and intervening, as appropriate, to ensure quality output  
• continuing advancement of personal area(s) of expertise through training, education, or participation in research or operational projects  
• communicating project outcomes by reporting, disseminating, presenting and publishing work undertaken at or for ACER  
• promoting ACER’s public profile by effectively engaging, collaborating and partnering with external stakeholders across academic, government and industry bodies 

 
Leadership and Administration 

• Lead, manage and coach for optimal individual and team performance  
• Identify skills gaps and recruit and develop staff within the unit  
• Monitor staff load levels, seeking to balance staff availability with ongoing and incoming project work  
• Identify, initiating and attracting external funding for strategically important projects  
• Develop financially viable proposals and projects across a number of specialist areas as well as ensuing delivery of clear and concise results  
• Lead teams through other managers, supporting their development, delegation, and decision making  
• Develop and building professional collegiality and networks through participation in events, forums, workshops and conferences  
• Contribute to ACER’s strategic planning and research agendas, including continuous improvement activities to enhance the delivery of research and/or operational outcomes 

Organisational accountabilities

• Proactively work towards achieving individual, team and organisational objectives while demonstrating ACER’s leadership behaviours:
  • Developing Self – involves self-management, self-reflection and self-improvement
  • Embracing Change – being open to change and leading change when appropriate
  • Pursuing Excellence – ongoing search for new and better ways of working
  • Setting Directions – strategic thinking and planning for the future
  • Supporting Colleagues – supporting and contributing to the development of others
  • Working Collaboratively – building highly effective internal and external relationships

• Actively work to create an equitable, fair and harmonious work environment which is free from harassment, bullying and discrimination by demonstrating respectful and courteous behaviour towards others
• Proactively foster an inclusive and diverse work environment which encourages and respects different experiences and perspectives, and values diversity of thought
• Comply with all occupational health and safety requirements, including following safe work practices for self and others and identifying, assessing, and mitigating psychosocial risks
• Comply with all information security requirements, including completing regular security training and abiding by the standards and procedures laid out in ACER’s Information Security Management System
• Work in accordance with ACER’s policies and procedures

Skills, knowledge and experience

• Internationally recognized expertise in a relevant discipline with an established record of productivity demonstrated in appropriate professional forums. 
• Extensive experience in leading and managing highly specialized technical expert staff and coordinating multi-disciplinary teams. 
• Demonstrated experience in high-level planning, organizational, and deep technical problem-solving skills which enable achievement of project objectives. 
• Proven experience leading, managing, and developing people and teams through multiple levels of management. 
• Demonstrated experience successfully leading large, complex, collaborative research and/or operational projects that deliver to quality standards, timelines, and budgets. 
• Proven ability to collaborate and foster effective working relationships, both internally and externally, across industry, academia, government, and community. 
• Proven experience consulting, influencing, and negotiating to achieve outcomes. 
• Skilled in diplomatic problem resolution in the face of challenging issues, demanding clients, and conflicting demands. 
• Financial management experience including proposal budget development, project budget monitoring, and management. 
• Demonstrated commitment to continuous improvement and professional development of self and others. 

Education 

Doctorate or an equivalent combination of professional experience and postgraduate qualification in a relevant discipline.