Meet the New GSE: The Ultimate Achievement in Cybersecurity Certification | GIAC Certifications

Meet the New GSE: The Ultimate Achievement in Cybersecurity Certification

The GIAC Security Expert certification has evolved.

May 31, 2023

We are celebrating the 20th anniversary of the GIAC Security Expert (GSE) certification this year! As someone who is has been a fan of GIAC/SANS for more than 20 years and lucky enough to be an employee for almost 18 of those, now seems like a good time to discuss how the GSE has evolved since it was introduced.  

After a trip through the Wayback machine, I unearthed a couple of blog posts about how the GSE got its start in 2003:  

I still remember the moment I read that second post from June of 2003, because I was studying for my GSEC at the time.  I thought to myself, “Wow – Lenny and John are nothing less than modern day heroes! What a wonderful achievement!  What a wonderfully difficult and complex thing the GSE must be – I cannot imagine!” 

A few years later, I found myself working at GIAC and tasked with helping to create the next version of the GSE— for me, a dream job with a Herculean challenge!  

The GSE went through many revisions from 2006-2019. The earliest of those were on the rough side compared to where we ended up. The labs got better over the years as the technology and talent got better. I earned the GSE myself in 2013 when a new version of the lab was introduced.  By the end of 2019, we had six GSEs on staff and GIAC had certified 255 GSEs over the course of 16 years.   

However, as the industry grew and evolved, the GSE wasn’t scaling well. Those relatively few candidates who were willing to deal with the logistics of a live lab that only ran twice a year at SANS US-based conferences had to wait 45 days for their lab results. We tried to grow the program to meet demand, but there were ever increasing logistical and technical challenges with delivering a live lab, and we were worried about scaling the quality.   

And then 2020 happened and the entire world was locked down. COVID kept GIAC from running a live lab in 2020 and 2021. All that time, we were building a backlog of unhappy candidates to whom we could not deliver a live lab. Would this spell the end of the GSE program? Some thought so.  

Yet, most of us felt that GSE must go on. The simple fact is a far greater percentage of GSEs have gone on to be thought leaders and difference makers in cyber security than any other credential. What could be more in alignment with our mission at GIAC/SANS than that? All of us who had skin in the game (held the GSE) felt that the GSE must survive, and so we began to innovate and think about how we might be able deliver a lab remotely – not only to solve for COVID, but maybe to solve for scaling problems for the future of the program. 

Many GIAC employees are very technical, with extensive backgrounds in cyber security. We have often come up with CyberLive content (GIAC’s hands-on practical testing environment) that is too difficult or too challenging to use for standard GIAC certifications exams. That got us thinking… What if we set our most technical people free to create GSE-level content in the CyberLive environment? Could we create GSE-level content in CyberLive?   

After some internal debate, senior management gave us permission to try it. After all, we had to do something to flush backlog in the GSE queue. Without doing something, the alternative would be effectively pulling the rug out from all of those who were waiting since COVID shut things down.  

By the end of our experiment, we created the best, most difficult content to appear on any version of the GSE…. ever.  We alpha tested the content internally with existing GSEs, and we all thought it was at least as difficult as the old lab while being better, more thorough exams to boot. We then beta tested throughout all of 2022, using two large very cohorts from the existing GSE queue. The content performed even better than we imagined, both statistically and psychometrically. 

Satisfied with the content of our new GSE lab, we went back to an idea that had previously been on the table to address two primary concerns:   

  1. Existing GSEs felt like there were not enough of them for the credential to have enough presence in the market to make a difference. They wanted us to figure out how to market the GSE, and that also meant we had to be able to scale it.   

  2. People who never attempted the GSE, including many SANS instructors, felt like it wasn’t relevant to them or their career path. Penetration testing, digital forensics, and cloud security were not part of the content, and there was no room for it to grow.    

We realized that we could create GSE-level content for any technical domain where we already have a CyberLive certification. We don’t have to be limited to those older domains that gave rise to the content in the old GSE lab. The field has changed in 20 years, and it was time the GSE changed, too.  

Furthermore, it is no longer possible for a single person to be an expert in every aspect of cyber. The challenge we were now left with was, how can we add new content to the program as we go forward in a way that protected the spirt of the GSE. This brings us to the genesis of the Applied Knowledge exams (noted with the letters “GX-” which stand for “GIAC Experienced” 

The idea here is that a true expert (at least in the GIAC/SANS sense of the word) has real hands-on chops and will be able to demonstrate technical depth in multiple areas of cyber security.  The exact areas don’t matter as much, as those change over time. What matters is being able to demonstrate the ability to solve hard problems that exist in our field.  

Each Applied Knowledge/GX- exam is a potential component of a new and improved GSE lab that can be delivered remotely. After all, required GX- lab components (depth) and Practitioner certifications (breadth) are earned when the GSE is awarded. While our initial launch includes three already-released Applied Knowledge exams, we intend to release more Applied Knowledge exams as we go forward in time. Each one will cover GSE-level content in a different domain, allowing experts to create a GSE that matches their own career, while also ensuring that those who earn the GSE are the best in the field. 

In the end, the outcome of the changes is a GSE that is more robust and flexible than ever before. Both the data and my 18+ years of experience with the GSE and testing support this.  Now take a look at the below tables comparing the Fall 2019 version of the GSE lab to what we are offering going forward: 

Requirements

 

GSE Pre 2020 

GSE as of 2023 

Lab / Applied Knowledge Exams 

1 four-part lab required (15 hours) 

4 four-hour exams required (16 hours) 

Entrance Exam 

Required 

Not required 

Practitioner Certifications 

3 - 6* 

6 required 

*Note: Previously, Practitioner Certifications could be substituted for Gold Papers and vice-versa, so the minimum was three Practitioner certifications plus two Gold Papers. 

Content

GSE Pre 2020GSE as of 2023

Labs 

Focused on advanced, technical content built on a superset of GSEC, GCIA, and GCIH 

Focused on advanced, technical content built on a superset of GSEC, GCIA, and GCIH, GCFA, GPEN and more 

Difficulty  

Very, Very hard 

Very, Very hard - in fact a bit harder than the historic lab 

Incident Response Report 

Required – 25% of lab time.   

None – Replaced with hands-on, technical content 

Updates/Currency 

Manual labs were difficult and time consuming to update, so updates weren’t done very frequently 

Content can be added/removed easily,  which allows the new exams to be much more current with changes in the field 

Exam Length 

Way more tasks than most people can fully complete in allotted time 

More tasks than most people can fully complete in allotted time 

Feedback 

None solicited or accepted other than occasional one-off e-mails 

Ability for candidates to comment on each item; is tracked just like standard exams.   

Testing Logistics

GSE Pre 2020GSE as of 2023

Delivery 

Candidates must travel to a live lab offered only twice per year 

 Proctored live and online 

Availability  

Lab limited to 30 individuals 2x per year 

Virtually unlimited capacity 

Convenience  

Somewhat challenging to extremely challenging, depending on candidate’s lifestyle and location in the world 

Much easier for all  

Results Notification 

Emailed 45 days later 

Automated, near instantaneous 

Risk 

With the old lab if you were very good in some areas but not quite at the GSE level, you got nothing for all your effort, time, and money 

With 4 distinct exams replacing the lab, if a student  excels in some domains but still needs to improve in others, they can be recognized for where they are already excellent as they continue to improve their skills in other areas. 

Quality

GSE Pre 2020GSE as of 2023

Test Reliability**

Relatively low due to low number of scored items 

Much higher due to higher number of scored items (25 per domain) 

Scoring Consistency 

Errors, subjectivity, and bias possible to manual scoring and written report 

Automated scoring is state of the art in consistency 

Psychometrics 

Limited item performance data had to be manually tracked by hand 

Reliable and built-in just like every other GIAC exam 

Versioning 

Relied upon individual with golden VM images 

Centrally managed and built-in just like every other GIAC exam 

Inter-Rater Reliability 

Inherent concerns with written report and manual scoring of lab exercises 

No concerns with automated scoring   

Lab Testing Consistency   

Occasional problems in the live lab environment with hardware, software, or cabling caused an inconsistent experience for a minority of candidates. Although accommodations were made onsite, this was suboptimal 

Our CyberLive lab VM images are stable and reliable, ensuring that every candidate gets the same experience  

Test Environment Risk 

We never had a catastrophic failure where we had to send everyone home, but that risk was always there. We did have several complete failures of the lab at the individual level over the years.  Those poor souls went home empty handed (other than a free ticket to the next lab offering) 

Catastrophic failure risk is minimal, and if there is an Internet outage, standard GIAC policies apply 

**Test reliability is the definition of how consistent a measure is of a particular element over a period of time, and between different participants.  https://www.psychometrictest.org.uk/test-reliability/ 

Market Presence

GSE Pre 2020GSE as of 2023

Relevance 

Limited to the cyber defense focus of original pre-requisites (SANS retired one-third of those original six courses) 

Designed to scale as technology changes; as we introduce new GX- exams no technical person in cyber will be able to say the GSE can’t be tied to what they do 

Scalability 

Limited by the size and number of live labs we could offer 

Limited only by the number of people who have the skills to pass the exams 

Difference Maker 

Although many GSEs went on to make big names for themselves in cyber security, their meager number limits how much good GSEs can do 

More experts in the fight will be able to win more cyber security battles 

Market Awareness 

The GSEs who certified on this version often complained that most employers are not aware of what the GSE is 

With scale limits removed, we can now educate the industry on how GSEs can help improve security teams