ITIL V3 sample exam question: is it just vague or plain wrong?

Submitted by skeptic on Fri, 2008-02-29 13:12

Share this post with

It is sample exam questions like this that give candidates the cold horrors.

Published in The Skeptical Informer, March 2008, Volume 2, No. 3

Comments

Submitted by Visitor (not verified) on Fri, 2009-08-07 21:10.

Baseline

Baseline assessment would be my move. First thing in improving a system or solution is baseline it's current performance under normal operation. 'Carry out a baseline assessment to understand the current situation' .... then screw a few quid out of them and leave them with dreams of a future where alls rosy - ITIL 101.
'A' cannot be correct even for ITIL cos everyone knows you'll get no sensible useful answers from 'the business', even if you can identify a spineless fcukwit who will represent 'the business'.

Submitted by tim (not verified) on Fri, 2009-08-21 05:54.

Thanks for giving me a laugh.

Submitted by print_iq (not verified) on Tue, 2009-04-28 10:29.

CSI

the answer is B is the right one for the first step of CSI Model is to Carry out a baseline assessment to understand the current situation, cause you have to know where you stand right now agains the baseline the ITIL provide

Submitted by Al Maurer (not verified) on Wed, 2008-05-28 21:34.

It's the OODA loop!

OK, I've come late to this discussion, having been working with Sample Papers 3 & 4 and new to Sample Paper 6. Thinking ITIL, I would have guessed answer b. In ITIL, all the processes start with figuring out where you are, making a plan, then acting on it.* That immediately narrows it down to a & b--but b is the better answer because it's more inclusive of figuring out where you are. a refers to the business side b is the situation generally.

So I think it's typically tricky but not ambiguous.

* That is a lot like Plan-Do-Check-Act or in Col Boyd's formulation Observe-Orient-Decide-Act. The OODA Loop. :-)

Submitted by D Wells (not verified) on Tue, 2008-03-04 01:52.

Simple mistake?

It may be that this is just a simple mistake? Interestingly, the identical question appears in Sample paper 4 for the v3 Foundation (Question 11). In this paper the correct answer is also "b". However, we are given slightly different options and "b" reads "Understand the vision of the business".

I always understood this to be an unambiguous (correct) answer, although it appears something has been 'lost in translation' between sample paper 4 and sample paper 6!

By the way, I too have been awaiting a response from ISEB on this particular issue ...

Submitted by Visitor (not verified) on Fri, 2009-08-07 20:57.

But the point is

if you are going to preach a new doctrine to highly skilled people who know what they're doing, then the least you can do is get your answer straight. ITIL is a pile of shite

Submitted by skeptic on Fri, 2009-08-07 21:06.

highly skilled people

"highly skilled people who know what they're doing"? IT skill levels are high only on technical topics - the toys. Process skills are patchy, with lots of low patches. Interpersonal and cultural skills are generally awful. And most of all professionalism is very low - most IT people are like you - closed-minded aggressive cowboys who don't see why they shouldn't be allowed to ride free, who just HATE the ITIL concept of accountability. As a result, IT DON'T know what they are doing, not holistically enough to get the job done. that's why high percentages of changes and projects fail, why services fail (incidents) and why customer dissatisfaction levels are so often high. if IT people knew what they were doing IT would be just another business unit and we wouldn't have all these debates

Submitted by Visitor (not verified) on Fri, 2009-08-07 21:20.

No skeptic...

IT people are not all as you describe. IT people are professionals with professional acccreditations and often highly trained. ITIL is an effort by the BUSINESS to force IT to conform to their lack of understanding. The reason most projects fail is because of poor definition. IT can attempt to gather requirements from the business, but when one pokes an elephants ass, one gest a pile of shyte. And, don't underestimate me boyo, I'm not even IT, I'd eat you for breakfast without a doubt ;-) Is mise le meas, Demne.

Submitted by JamesFinister on Sat, 2009-08-08 11:29.

Sad but true

Some of what you say is true, but first of all lets us be clear that what makes a professional isn't just technical skill. When I go to a professional for advice I also expect, as an example, adherence to a clear ethical code - though I might not agree with it myself. If I go to a libel lawyer for advice on a comment made on a forum, for instance, I expect the lawyer to give me impartial advice independent of their own views.

ITIL, incidentally, was not created or promoted by the business, and I suspect the business doesn't currently care less about it. On the other hand the CIO probably does.

Yes I agree the business probably doesn't know what it wants, but part of the ITSM philosophy is that the responsibility for helping them define what they want rests with us. If a client went to an architect and said they wanted rooms 1m tall the architect would be at fault not to point out they couldn't stand up in that space.

Submitted by Alison Adams on Wed, 2008-03-05 15:44.

Lost In Translation...

D - I agree entirely that Paper 4 Q11 is a completely reasonable question with no ambiguity.
So what on earth went wrong with the amendment in Paper 6 and why didn't anybody notice before it went public ?!
I just had a discussion on this with my class as we used paper 6 as a 'mock' and I have asked them to let me know if the question appears in their real exam - I dont know what to advise them - put the APMG answer or the right answer ?!
I posted this on itSMFI too, hoping for an answer there or to my email to ISEB/APMG.
Still waiting.....

Alison

Submitted by Alison (not verified) on Thu, 2008-03-20 06:57.

Just Plain Wrong !

Rosemary Gurney was kind enough to respond to this via the itSMFI bulletin board and confirmed a 'typo' that sneaked through QA. It is fixed in sample paper 7. For Rosemarys full comment see http://www.itsmfi-forum.org/view_topic.php?id=307&forum_id=12&jump_to=945#p945

Alison

Submitted by Liz Gallacher on Thu, 2008-03-20 08:37.

how do such typo's happen?

Firstly - this was not just any typo - a misspelling or such. SURELY you check and double-check the correct answers are given! The same thing happened with the "How to pass your V3 exam book", which lessened the credibility of an otherwise good book.
Equally worrying is the answer given on the itsmfi forum:-

"The examination team responsible for the v3 Foundation papers, both live and sample find it difficult to comment directly on this forum to queries surrounding specific questions, even if they are aware of them.
This is because they are contracted to APMG as the Official Accreditor and the agreed channel for communication of this nature is from the Accreditor, to all of the respective Examination Institutes and then to Training Providers.
The examination team have been aware of the issue regarding this particular question for some time, they have advised APMG and have resolved the issue. They are not responsible for issuing any communications.
However, on this occasion I am happy to advise that the cause of the issue was quite simple. An error was made during the data entry phase, answer 'B' was input whereas it should have been answer 'A' and this was missed during subsequent QA.
This has been corrected and additionally, Option A has been reworded to - Understand the business objectives.
The question is still available as a sample and will appear on Sample Paper 7 which will be issued shortly. At this time, all Training Providers will be advised to retire Sample Paper 6
from use."

So, when mistakes are spotted, they are not communicated properly, and the answer each time is to issue another paper. Am I the only training provider who prints student manuals to include the mock exams - as mine are spiral-bound, that makes changing them rather difficult!
Liz Gallacher
Freelance Trainer and Consultant

Submitted by buraddo on Sat, 2008-03-01 06:21.

So whats new!!

So when have any ITIL exams been anything other than ambiguous and misleading.. They are based on the British higher education system which tests comprehensive more so than understanding.

I once tried to bring a group of non-native english speakers through the management exams, before local language was available, and it was very sad.. Bright people, with great understanding, completely demoralized by language comprehension.

Another reason why the certification structure is completely wrong for this and most other professional education schemes. When did "professionals" become too high and mighty to service an apprenticeship. When did education and experience take such different paths. What happed to education through immersion.

As I have said before. Nothing has disappointed more, since the infestation of IT Datacenters by Certified Netware Engineerings in the late 80s and 90s.

Brad Vaughan
http://blogs.sun.com/buraddo

Submitted by Visitor (not verified) on Wed, 2009-12-09 19:45.

You are totaly right! the

You are totaly right! the ITIL exam is more about comprehension of the english language under their terminology. I work in IT. If a customer asks me to order them a desktop bundle, I order a desktop bundle. It's now called a CTI according to ITIL

Submitted by Visitor (not verified) on Fri, 2009-08-07 20:55.

Good man

Well said. Is mise le meas, Demne.

Submitted by JamesFinister on Sat, 2008-03-01 07:37.

Don't knock the Brits ;-)

Brad,

I'm not sure what your experience of British higher education, is but over the years I would say its influence on the exams has kesseneed, not increased. I trained candidates for both the highly Dutch influenced EXIN exams and the British ISEB exams and in the early days the ISEB exams were head and shoulders above the EXIN ones in terms of testing true understanding - though they were far from perfect. The early manager's exam featured the need to write long essay answers that drew equally on your knowledge of the books and on your real life experience. They even allowed freedom to have some debate with the examiner. The move towards multiple choice questions, especially at the post foundation level, isn't something you find at British universities. Personally I'm not against multiple choice questions in the right context if they are well written. I think anyone who has undertaken the ISACA CISA exam will tell you it is no walk over and the questions really make you think.

James

Submitted by Liz Gallacher on Sun, 2008-03-02 14:49.

It is not a Brit problem

I agree with James - the problems with the V3 exams is nothing whatever to do with the British education system (even if such a thing exists - the Scottish curriculum, secondary school exam structure and university degree structure is very different from England). Multiple choice is seldom used, and the belief commonly voiced in the UK is that the problems with ITIL V3 exams stem from catering to an American approach to education and testing(which may be equally unfair).
The real problem is the way that the questions emerge from the examiners board (which, with its global representation, is far less likely to take a British or Dutch approach). Writing good multiple choice questions, which truly test understanding is a skill. I tried it myself some time ago, and gave up - I do not have the skill required, despite my ITIL knowledge. The members of the board may be very learned, but not have this skill. There should have been wider consultation, the proposed questions should have been opened to a wider audience of reviewers/trainers etc. Instead we have questions released, then withdrawn, which gives a very poor impression.

As far as the written examination for V2 managers is concerned - as a trainer and examiner, I find it strange that it is so misunderstood. It is not, and has never been, about writing essays. It is about providing written answers - in bullet points, tables, or in a report-format, which cover the points in a logical way, and demonstrate understanding. Surely anyone operating at a manager level has to do this all the time in their real jobs - writing reports, giving presentations, etc. It IS under exam conditions, with a time limit, but a good candidate can get a pass mark for a question from 2-3 pages. It is the ones who waffle, or brain-dump who struggle with time.

Liz Gallacher
Freelance Trainer and Consultant

Submitted by skeptic on Sun, 2008-03-02 20:54.

the driver for the use of multiple-choice exams is commercial

"the belief commonly voiced in the UK is that the problems with ITIL V3 exams stem from catering to an American approach to education and testing". Voiced in New Zealand too :-D

But even though I think the American education system produces new-age numbskulls who are inarticulate and bordering on illiterate and the American media pounds their remaining brains into 30-second pap-machines that couldn't write a meaningful paragraph, I suspect the real driver for the use of multiple-choice exams is purely commercial: marking can be automated, eliminating the need for expensive paper-markers.

Evidence indicates that many certification and training decisions are now made with the profitability of the vendors in mind not the education of the trainees.

Submitted by buraddo on Mon, 2008-03-03 03:48.

Its not all about Multi-guess

So I will take back what I said about the Brit education system. It is my cultural birth right as an Aussie to heckle the mother land as much as possible. They are only complicit in developing the modern mass education system.

Ignorant controversial ramblings follow

"The French (inventing the university) and the Italians (via the Roman Catholic Church, inventing multi level schooling) are as much to blame. Before these things, education was more of an apprenticeship, with scholars, artists and professionals able to show a direct genealogy to there mentors. Your skill was given credibility through who you worked with and the exposure they gave you to success. I don't care whether the V3 exams have British or Dutch influence. Paper based education and exam based certification is just a poor instrument for creating capability."

I am not sure if multi-guess is necessarily the problem. Its a tool to measure content knowledge and if done properly, can be good as any other. But capability is X parts knowledge & Y parts skill & Z parts experience. Its true that the cost of marking the exams is almost eliminated through the use of multi-guess.

I think it is right to say that the whole concept of exam based certification is driven by a financial motive. Having a certification scheme is a known method for improving adoption of any framework. Companies are always looking for ways to try and quantify the skill of staff.

There is nothing about the way the certification scheme measures success that can reinforce the goal they state for the certification. They make no attempt to measure if the courses work (I think skep you made the commment about feedback). So growth, adoption and revenue can be the only measure, and therefore motive.

Brad Vaughan
blogs.sun.com/buraddo

Submitted by skeptic on Mon, 2008-03-03 07:33.

professional certification as an annually renewed status

Agree with Jim: the model of professional certification as an annually renewed status administered by a governing body who track ongoing professional development and behaviour becoming a registered professional is the way to go. It is also light-years ahead of the capability or intent of OGC, APMG or itSMF. IOSM tried but muffed it. I said on ITSM Watch

There was nothing until recently that provided certification and college for practicing [ITIL] professionals. Now we have the Institute of Service Management in the U.K. and the newly formed Institute of Certified Service Managers, or the IT Service Management Institute in U.S.

Do any of these have the official recognition of OGC? What governance does it provide over their activities or standards? Why is the ICSM-USA only for ITIL “masters” but the U.K. body more broadly for “senior ITIL-ers”? Because nobody is internationally regulating the emergence of these bodies.

and in another article

We [in IT] still have a long way to go to meet the levels of best practice set by other industries. A professional is measured by three attributes: their attitude, development and ability...There needs to be international standards of tertiary qualification, and very different courses offered by the universities. There needs to be international networks of accreditation. Most of all there must be much higher expectations set of the people we entrust with these huge projects.

Submitted by buraddo on Mon, 2008-03-03 08:19.

The saviour of the investment

I posted a comment on the other topic from skep related to this

http://www.itskeptic.org/node/479#comment-2409

Continuous Certification like the PMP model will help to prolong the life of the certification and stem to rot created by commodotizing the system. It create the ability to extend the brand to other partners and products which make people continually invest in the model. And the reason I know why the lord of ITIL are thinking on this, is it could double, triple or even quadruple the revenue per customer they have now..

Brad Vaughan
blogs.sun.com/buraddo

Submitted by buraddo on Mon, 2008-03-03 08:13.

PiMP your ITIL Cert :)

I still think the continuous certification model used by PMP and others (even in different industries) falls short is that it is only requiring more book based learning or in most cases just attendance. It is really just measuring interest and commitment, not capability..

Brad Vaughan
blogs.sun.com/buraddo

Submitted by JamesFinister on Mon, 2008-03-03 09:01.

CPE

We should keep a distinction between a practical experience based component to the inital qualification, and an on going CPE element post qualification. With both, however, there are practical issues to consider. Who, for instance, decides what qualifies as CPE, where do we find people suitably qualified to assess practical work, and how do we deal with the possible mismatch between the whole range of ITIL processes and functions compared to the span of control of an individual candidate.

And how do we stop it becoming another revenue generating self perpetuating aspect of the industry?

Submitted by JamesFinister on Mon, 2008-03-03 08:50.

Exam driven training

Brad,

One of the implications of the changes in the way ITIL is examined, which IIRC dates back to the v2 refresh, is a shift in the way the subject is taught. V1 training schemes focussed less on exam technique and practice and more on developing ideas. I know from speaking to some of the early examiners that they often found new insights by reading what students had written. We also took into account a delegates performance on the training course itself. I think this used to attract up to 10% of the marks, and we took the assessment very seriously.

Now it sems the training is more black and white and not aboput development of the individual.

ISACA seperate out technical competence evidenced by exam success from on the job certification by professional peers. Perhaps a way ahead?

Submitted by buraddo on Sat, 2008-03-01 08:34.

Keeping it in the Empire

My experience with British education comes only from what was transplanted into Australia.

Still whether short-answer (which really becomes an issue of translating knowledge into concise text) or multiple choice (which when written in ambiguous form as per this blog entry example or using the classic, which answer is more right than the others trick) is still a test in english comprehension and not understanding.

I stick by my original concern. Its not whether they make you think, but whether they make you think about the right stuff.. I have no doubt that they are challenging, but a accomplished student can always win over and accomplished subject matter expert.

Brad Vaughan
http://blogs.sun.com/buraddo

Submitted by ITSMdoc (not verified) on Fri, 2008-02-29 21:36.

Vague Questions

Some of my friends sitted Foundations recently and I compiled a list of questions they had. Some 70% of them are logical and easy, some are light brainers, but some 5% look impossible to answer on that attendee level. I have read all 5 (6) books, some of them a few times, and they still take 5-10 minutes to answer with literature and all.
I still think that (given the scope of v3) foundations level exam should be a little more then knowing the glossary, knowing what is what and what is where. There are other levels for showing off.

Submitted by IT Governance Blog (not verified) on Fri, 2008-02-29 15:55.

Ambiguous

I chose A as well but A and B are very ambiguous to me. A doesn't really say HOW to assess - at least with B there is the action of establishing a baseline. But I don't believe you can know WHAT to baseline until you've done an assessment, which is why I chose A. And based on what is described as being documented, it seems clear it must be A.

I'll bet there are more than a few of these...

Bill