Home   >   CSC-OpenAccess Library   >    Manuscript Information
Asking Users: A Continuous Evaluation on Systems in a Controlled Environment
Suziah Sulaiman, Dayang Rohaya Awang Rambli, Wan Fatimah Wan Ahmad, Halabi Hasbullah, Foong Oi Mean, M Nordin Zakaria, Goh Kim Nee, Siti Rokhmah M Shukri
Pages - 34 - 42     |    Revised - 20-02-2009     |    Published - 15-03-2009
Volume - 3   Issue - 1    |    Publication Date - February 2009  Table of Contents
usability, continuous improvement, decision making, evaluation
A continuous evaluation on the usability of an existing system is necessary in order to ensure users’ satisfaction when interacting with the system. Seeking users’ subjective opinions on the usability of a system could capture rich information and complement the respective quantitative data on how well the system is in supporting an intended activity. This paper presents a case study that identifies usability issues of the systems currently used in the main control room of an oil refinery plant. A set of survey questions was distributed to the control operators of the plant in which 31 operators responded. Results from the quantitative data suggest that in general respondents were pleased with the existing system. However, it could be claimed from the data that experienced operators are more concerned with the technical functionality while the lesser experienced are towards the usability of the system interface. The respondents’ subjective feedback provides evidences that strengthen the findings. The operators’ responses also revealed several issues especially on the system display, system design, trending, and information representation. The current working environment was also commented to affect the performance of the workers.
1 Google Scholar 
2 Academic Journals Database 
3 ScientificCommons 
4 Academic Index 
5 CiteSeerX 
6 iSEEK 
7 Socol@r  
8 ResearchGATE 
9 Libsearch 
10 Bielefeld Academic Search Engine (BASE) 
11 Scribd 
12 WorldCat 
13 SlideShare 
15 PdfSR 
A. Snodgrass and R. Coyne. “Interpretation in Architecture: design as a way of thinking”, London:Routledge (2006)
C.M. Burns, Jr. Skraaning , G. Jamieson, G. A. Lau, N. Kwok, J. R. Welch and G. Andresen, "Evaluation of Ecological Interface Design for Nuclear Process Control: Situation Awareness Effects”, International Journal of Human Factors, vol. 50, pp. 663-679, 2008
F. Chen, E.H.C. Choi, N. Ruiz, Y. Shi and R. Taib, R. “User Interface Design and Evaluation For Control Room, Proceedings of OZCHI 2005, Canberra, Australia, November 23-25, 2005, pp. 1-4.
G.A. Jamieson, "Ecological interface design for petrochemical process control: An empirical assessment," IEEE Transactions on Systems, Man And Cybernetics, vol. 37, pp. 906-920, 2007
G.A. Jamieson. “Empirical Evaluation of an Industrial Application of Ecological Interface Design”, In Proceedings of the 46th Annual Meeting of the Human Factors and Ergonomics Society, Santa Monica, CA:Human Factors and ergonomics Society, October 2002
I.M. Begg, D.J. Darvill and J. Brace. “Intelligent Graphic Interface Design: Designing an Interactive Control Room User Interface”, IEEE, pp. 3128 – 3132, 1995
J. Ketchel and J. Naser. “A Human factors view of new technology in nuclear power plant control rooms”. In Proceedings of the 2002 IEEE 7th Conference, 2002
J. Preece, Y. Rogers and H. Sharp “Interaction Design: Beyond Human-Computer Interaction”, John Wiley & Sons Inc.(2002)
J. Preece, Y. Rogers and H. Sharp, “Interaction Design: Beyond Human Computer Interaction”, John Wiley & Sons Inc. (2002)
J.S. Czuba and D.J. Lawrence. “Application of an electrical load shedding system to a large refinery”. IEEE, pp. 209-214, 1995
L. Norros and M. Nuutinen. “Performance-based usability evaluation of a safety information and alarm system", International Journal of Human-Computer Studies 63(3): 328-361, 2005.
P. Savioja and L. Norros . “Systems Usability -- Promoting Core-Task Oriented Work Practices” ,In Law E. et.al. (eds.) Maturing Usability. London: Springer(2008).
P. Savioja, L. Norros and L. Salo. “Evaluation of Systems Usability”, Proceedings of ECCE2008, Madeira, Portugal, September 16-19, 2008.
S. Faisal, A. Blandford and P. Cairns. ”Internalization, Qualitative Methods, and Evaluation”. In BELIV ’08, 2008
S. Greenberg and B. Buxton. “Usability Evaluation Considered Harmful?” In Proceedings of ACM CHI. Florence, Italy, 2008
S. Guerlain, G. Jamieson and P. Bullemer. “Visualizing Model-Based Predictive Controllers”. Proceedings of the IEA 2000/HFES 2000 Congress, 2000
S. Sulaiman. “Usability and the Software Production Life Cycle”, In Electronic Proceedings of ACM CHI, Vancouver, Canada, 1996.
S.H. Han, H. Yang and D.G. Im. “Designing a human-computer interface for a process control room: A case study of a steel manufacturing company”. International Journal of Industrial Ergonomics, 37(5):383-393, 2007
Vicente, K. J., Mumaw, R. J., & Roth, E. M., "Operator monitoring in a complex dynamic work environment: A qualitative cognitive model based on field observations", Journal of Theoretical Issues in Ergonomics Science, vol. 5, pp. 359-384, 2004.
Dr. Suziah Sulaiman
- Malaysia
Dr. Dayang Rohaya Awang Rambli
- Malaysia
Mr. Wan Fatimah Wan Ahmad
- Malaysia
Mr. Halabi Hasbullah
- Malaysia
Mr. Foong Oi Mean
- Malaysia
Mr. M Nordin Zakaria
- Malaysia
Mr. Goh Kim Nee
- Malaysia
Dr. Siti Rokhmah M Shukri
- Malaysia

View all special issues >>