Data processing and analysis

In recent years, the data landscape has evolved rapidly, creating for National Statistical Offices (NSOs) both significant opportunities for innovation and important challenges in maintaining data quality and reliability. In response to these developments, the Statistical Institute for Asia and the Pacific (SIAP) and the Ministry of Data And Statistics (MODS) are organizing a Regional Training on Data Science for Official Statistics, recognizing both the opportunities and the challenges associated with integrating Data Science methods and tools into NSO processes. 

Identifying and responding to the needs of users for data and statistics is at the heart of the mission of National Statistical Offices (NSOs) and national statistical systems. NSOs already undertake many activities interacting with different users such as preparing press releases to aid journalists and communicate with the public at large and organizing launch events/workshops to disseminate important results from surveys and censuses. In general, the NSO interacts with users towards the tail end of the statistical production process when the data is disseminated.

This e-learning course aims to build capacity in national statistical systems for the development and implementation of Reproducible Analytical Pipelines (RAPs) for Official Statistics.

National statistical systems are increasingly using administrative data to compile official statistics. Such data can be utilized to better meet the increasing demands for new statistics and indicators that are highly disaggregated. Administrative data is not collected for the primary purpose of compiling official statistics, and statisticians need to ensure that the data meets certain criteria before using it to produce official statistics.

In today’s rapidly evolving world, driven by technological advancements, climate change, and pandemics, the demand for timely, granular, and high-quality data is surging. National statistical systems must adapt, becoming more agile and responsive to emerging demands. This seminar will delve into how statistical systems can become more agile. The main topics covered in the ninth session of the Committee on Statistics are shown below. Three thematic areas have been identified that would benefit from further discussion at the level of chief statistician, shown in the circles.

The transition from paper and pencil interviewing (PAPI) to computer assisted personal interviewing (CAPI) has been one of the key hallmarks of national statistical offices’ (NSO) efforts to adopt efficient and cost-effective new technologies and modernize the collection and production of official statistics.

This e-learning course aims to build capacity in national statistical systems for the development and implementation of Reproducible Analytical Pipelines (RAPs) for Official Statistics.

What is a Reproducible Analytical Pipeline?

Simply put, reproducible analytical pipelines (RAPs) are automated statistical processes (data processing and analysis) that codify to the greatest extent possible the production of official statistics. Common tools that are used to develop RAP include software such as R or Python, and version control management tools such as Git.

This workshop is aimed at addressing the need of statistical offices and statistical units of agricultural ministries of producing timely statistics through adoption of new technologies for data collection and production of global minimum core data items. The workshop will provide a strong foundation in Computer Assisted Personal Interviewing (CAPI) functions. Participants are expected to acquire skills to implement a basic survey. 
 

This training course is designed to contribute to the following expected outputs of the Asia-Pacific Regional Action Plan of the Global Strategy: 
. Increased ability of National Statistical System (NSS) to access and use ICT for production and dissemination of minimum set of agricultural and rural statistics; 
. Improved capacity of countries to adopt cost-effective and reliable methods for producing a minimum set of agricultural and rural statistics. 

This training course is designed to contribute to the following expected outputs of the Asia-Pacific Regional Action Plan of the Global Strategy : 
 

• Increased ability of National Statistical System (NSS) to access and use ICT for production and dissemination of minimum set of agricultural and rural statistics;
• Improved capacity of countries to adopt cost-effective and reliable methods for producing a minimum set of agricultural and rural statistics.