Data from the New Zealand National Incident Database informs the development of UPLOADS

A recent article published in Accident Analysis and Prevention explores how injuries and near-miss incidents that happen during led outdoor activities (such as hiking, rafting, orienteering, trekking, etc.) are reported to the New Zealand National Incident Database (NZ NID).

This article presents an analysis of 1014 incidents from the NZ NID. A version of Rasmussen’s Risk Management Framework was used to classify the contributing factors involved in each incident. The analysis identified contributing factors across all levels of the led outdoor activity system, demonstrating the framework’s applicability to the led outdoor activity injury domain. 

In addition, some limitations were identified with the NZ NID data collection framework. The reports only include categories for contributing factors related to the immediate context of the activity (i.e. participants, instructors, equipment, and the environment). Identifying other factors requires manual coding of the description of the incident. This makes it difficult to quickly produce summaries across multiple incident reports. Moreover, only including categories related to participants, instructors, equipment, and the environment, may lead reporters to unduly focus on these contributing factors, while ignoring issues related to the management of outdoor activities, and other systemic issues.

This analysis informed the development of the prototype UPLOADS incident reporting system.

Thank you to the Mountain Safety Council for sharing the data collected through the NZ NID with the UPLOADS Research Team.

The full version of the article is available here.

Published source:

Salmon PM, Goode N, Lenné MG, Finch CF, Cassell E. (2014). Injury causation in the great outdoors: A systems analysis of led outdoor activity injury incidents. Accident Analysis and Prevention, 63, 111– 120.

Posted in Outputs, Systems thinking

Invitation for experienced supervisors, managers and risk managers to participate in UPLOADS coding reliability study (Ethics Number: A/14/604)

The goal of the UPLOADS project is to develop a valid and reliable incident reporting system for the outdoor education, recreation and adventure sector in Australia. One component of the system is a taxonomy that organisations can use to code the causal factors involved in their incident reports. This will allow organisations to easily generate aggregate reports on the data they collect, so they can identify trends and develop appropriate countermeasures.
 
The aim of this study is to test the reliability of the UPLOADS Causal Factor Taxonomy for classifying the causal factors involved in incidents. Reliability means: 1) Different people select the same codes to describe the same causal factor; and 2) People select the same codes to describe the same causal factor on different occasions. This indicates that the taxonomy is easy to use and simple to understand.

The study involves using the UPLOADS causal factor taxonomy to code four incident reports on two separate occasions (one month apart). It should take you approximately one hour to complete the task on each occasion. You will be emailed the response booklet and instructions. You can fill in the response booklet on your computer – there is no need to print it out. After completion you will need to email back the response booklet.

If you would like to participate in the study and are a experienced supervisor, manager or risk manager please register here:

If you would like more information, please contact:

Natassia Goode
Email: uploadsproject@usc.edu.au
Phone: 07 5456 5850

Posted in Invitations to participate in research

Who is in the “outdoor” sector? National Outdoor Sector Survey 2013

One of the challenges for the National UPLOADS trial is estimating the “reach” of the study. Ultimately, we’d like to have everyone in the outdoor sector in Australia using UPLOADS. For now, we need to get some idea of the proportion of organisations in the outdoor sector who are participating. However, obtaining an accurate estimate of the total number of organisations providing outdoor activities has proved quite difficult.

Fortunately for us, we now have a new source of data: Service Skills Australia’s 2013 National Outdoor Sector Survey (NOSS). The NOSS provides an overview of the education providers, businesses, organisations, workers and volunteers in the outdoor sector. The analysis contained in the NOSS is based on the responses from 275 organisations.

While this doesn’t represent everyone in the outdoor sector, it does give us a benchmark for comparing the number of organisations participating in UPLOADS. So far, we’ve got 40 organisations signed up. So going on the NOSS data, this represents 15% reach across the sector. Not too bad for our first three months!

Note:

SSA have also created an additional survey to allow readers to provide feedback on the NOSS: https://www.surveymonkey.com/s/8C86ZV8. The feedback from this survey will be used to feed into the continuous improvement process for the outdoor recreation component of the Training Package and to inform the 2015 Environmental Scan.

Posted in Uncategorized

UPLOADS Project Newsletter July 2014

Click here to read the UPLOADS Project July Newsletter – lots of exciting updates, including details on an upcoming training session in NSW.

Posted in Events, Newsletter

Risk assessment for outdoor programs

Is there a risk assessment process that outdoor programs should be using? How does the UPLOADS Accident Analysis framework link to risk assessment? These questions are raised again and again during UPLOADS training sessions.

Luckily for me (and the outdoor sector), Clare Dallat was recently awarded a PhD scholarship to investigate these questions. She’ll join the USCAR Research team in September to start working on developing a valid and reliable risk assessment process for outdoor activity providers.

At the recent Outdoors Victoria conference Clare and I conducted a workshop to start to tease out some of these issues. There’s not a lot of research around risk assessment specifically for outdoor programs, so we wanted to start by understanding why people conduct risk assessments, and identify key confusions around the process.

Responses to the question “what is the role of risk assessment in your organisation” were pretty variable. Key themes included: concerns about liability and creating a paper trail for the lawyers; legislative duties; the identification of potential hazards and control strategies; passing on knowledge about hazards to those who are less experienced (e.g. students and volunteers); and integrating accident analysis from other organisations into your risk management plans.

In these responses, there seems to be a tension between the goals that outdoor activity providers want to achieve through risk assessment (e.g. improved safety) and external pressures to complete paperwork. While there is no reason per se why these goals cannot co-exist, during the workshop doubts were raised over whether “compliance” necessarily means “safer”.

A second issue is whether one document can have the capacity to address all these aims. Even if we only examine the safety-related themes there is clear potential for working at cross purposes. For example, a detailed risk assessment and control plan may not be the best means of communicating about hazards to students and volunteers.

From the discussion within the workshop, it’s also clear that there is a lot of confusion around developing risk assessments. For example, what is required of a particular organisation or school? Why are there so many negotiables on the documents the OV website? What are the other standards that apply to my context? Why do HR departments have different requirements to what works in outdoor programs? What happens when schools have to outsource activities – who should do the risk assessment?

Obviously one workshop is not enough to even start to resolve these issues…but they are on the UPLOADS radar!

Click here if you’d like to view our presentation from the conference: Outdoors Victoria Risk Assessment

 

 

Posted in Events

UPLOADS Project Newsletter June 2014

Click here to read our June Newsletter – lots of exciting updates, including details on upcoming training sessions in VIC and WA.

Posted in Events, Newsletter

Parks and Leisure Research Connections

Parks and Leisure Australia produce an annual Research Connections journal to “stimulate the ongoing exchange of knowledge between researchers and practitioners” in the outdoors. UPLOADS is featured in the new issue:

http://www.parksleisure.com.au/documents/item/2639

Posted in Outputs

Toward safer led outdoor activities: why we need systems thinking, why systems thinking needs systems data, and why now we need you!

It is well known that incidents, regardless of severity, are caused by multiple decisions, actions, and conditions that interact with one another in a way that enables adverse events. This is the case in highly complex systems such as aviation and rail, just as it is the case in led outdoor activities.

For the outdoor education, recreation and adventure sector, this ‘systems thinking’ tells us that there are many things outside of the participants, instructors, and the activity environment that contribute to incidents during activities. There is far more to it than just the things close to the event. These contributory factors might include issues related to procedures, risk management systems, training programs, policy and legislation, recruitment and staffing, supervisors, managers, CEOs, auditing, regulation etc. The list goes on and on; incidents in this sector are a complex beast.

So what can we do about it? For incidents prevention efforts it is critical that we use systems thinking to cope with this complexity, to tell us everything we need to know about why incidents are happening. We need to find out more than just ‘slippy terrain’, ‘participants fooling around’, and ‘poor instructor judgement’. What else played a role…days, weeks, even years before the incident? Only then can we make the kinds of changes that will truly prevent incidents.

Though it is tough, thankfully it is not impossible, to understand some of this complexity. The first step involves accepting that incidents are a systems problem. Most of the sector has already embraced this (and if you are reading this you are probably one of the converted).

The second step involves collecting appropriate information so that we can understand what the systemic problems are. Systems thinking needs systems data. This is the difficult part. We need the right tools to help us collect the right information that will enable us to develop an in-depth understanding of the causes of incidents. This will show us how certain things interact with one another to enable incidents. From the outset back in 2009 the goal of the UPLOADS program of research has been to provide those working in the outdoor education, recreation and adventure sector with the tools to enable collection of systems data.

After much blood, sweat, and tears (and plenty of good solid research) the UPLOADS system is finally ready. We have reviewed, specified, developed, tested, evaluated, argued, tweaked, refined, and improved the prototype to a point where we can do no more. It is time to hand it over to the sector for a full scale trial. This is both exciting and scary at the same time, but the excitement far exceeds the trepidation. This is because we are about to get the data that systems thinking needs. The data that the sector needs. Systems thinking can only work when there is systems data. This is what UPLOADS is all about, and because of UPLOADS we are about to better understand all kinds of incidents.

So here it is. Take a look around the website, read all about UPLOADS and how it works, look at the publications and presentations describing its development. But more importantly, sign up for the UPLOADS national trial. Buy in from the sector is critical. So far you have made a fantastic contribution, a huge contribution. UPLOADS would not be here without it. But now is the time to make the contribution that really matters.

We need as many organisations as possible across Australia, large and small, to use UPLOADS. Simply put, the more data we get, the more injury incidents we better understand. The more injury incidents we better understand, the safer we can make led outdoor activities across the board. Over to you!

Paul Salmon

 

Posted in Systems thinking

Highlights from the 18th National Outdoor Education Conference

Outdoor Educators’ Association of Queensland (OEAQ) are presenting an evening of sharing the most relevant presentations from the recent National Conference in Adelaide with OEAQ members and other interested participants who could not attend.

Natassia will be presenting an overview of the UPLOADS National Trial and her presentation at NOEC2014.

More details on how to register can be found on the OEAQ events page.

 

Tagged with:
Posted in Events, OEAQ

Invitation to UPLOADS National Trial Launch in Victoria

Come along and learn how to use UPLOADS to collect incident and participation data, create automatic reports and analyse the causal factors involved in incidents within your organisation!

When: 1pm – 5pm, Wednesday, 30th April 2015

Where: Sport and Recreation Victoria, Room 2, Level 15, 1 Spring Street, Melbourne

Please RSVP to Jess Hough at the ACA Office editor@auscamps.asn.au or 03 9365 7100

If you cannot attend the launch, but would like to participate in the trial or would like more information, please contact: Dr Natassia Goode (Project Manager), Phone: +61 7 5456 5850, Email: ngoode@usc.edu.au 

Posted in Events
Upcoming Events

No upcoming events

Enter your email address to follow this blog and receive notifications of new posts by email.

Follow us on Twitter