Link

Social

Embed

Disable autoplay on embedded content?

Download

Download
Download Transcript


[00:00:07]

GOOD MORNING

[1. Call General Session to Order]

EVERYONE, AND WELCOME MEMBERS OF THE TECHNOLOGY AND SECURITY COMMITTEE AND GUESTS.

I'M JOHN SWENSON, I'M THE COMMITTEE CHAIR.

UH, WELCOME TO THE FEBRUARY 26TH, 2024 MEETING OF THE TECHNOLOGY AND SECURITY COMMITTEE.

I CALL THIS MEETING TO ORDER.

THIS MEETING IS BEING WEBCAST LIVE TO THE PUBLIC ON ERCOT WEBSITE.

BEFORE BEGIN, I'D LIKE TO ASK TOM GLEASON IF YOU'D LIKE TO CALL AN OPEN MEETING OF THE PUBLIC UTILITIES COMMISSION.

AND I SEE YOU ALL BY YOURSELF, SO I ASSUME NO.

UM, SO BEFORE MOVING ON TO TODAY'S BUSINESS, I'D LIKE TO HIGHLIGHT TO THE COMMITTEE MEMBERS THE ANTITRUST ADMONITION AND SECURITY MAP THAT ARE INCLUDED IN THE POSTED ANTITRUST MATERIALS AND ARE ON THE SCREEN IN FRONT OF YOU.

TODAY'S FIRST ORDER OF BUSINESS ON THE AGENDA IS ITEM TWO, NOTICE OF PUBLIC COMMENTS.

TODAY'S MEETING AGENDA WAS POSTED PUBLICLY ON FEBRUARY 19TH AND PROVIDED INSTRUCTIONS FOR THE PUBLIC FOR COMMENTING IN PERSON.

TO DATE, NO ONE HAS EXPRESSED INTEREST.

IS THAT CORRECT, JOHN? YES.

SO, SEEING NO ONE, WE WILL PROCEED WITH THE AGENDA.

THE NEXT ITEM IS AGENDA ITEM

[3. December 18, 2023 General Session Meeting]

THREE, THE MINUTES FROM THE LAST MEETING.

UM, THERE'S A DRAFT APPROVAL IN THE MEETING MATERIALS.

SENATOR HUN, HAVE ANY COMMENTS OR QUESTIONS OR BETTER, STILL WANTS TO OFFER A MOTION TO APPROVE? SO MOVED.

SECOND.

ANY OPPOSED? ALL IN FAVOR? MOTION IS CARRIED.

THANK YOU.

UM, NOW ONTO,

[4.1 Projects and Technology Update]

UH, COMMITTEE BRIEFS, UH, STARTING, UH, WITH ITEM 4.1, WHICH IS THE, THERE ARE GONNA BE THREE SUB ITEMS HERE.

JP WILL PRESENT THE FIRST TWO, STARTING WITH ITEM 4.1 PROJECTS AND TECHNOLOGY UPDATE, FOLLOWED BY 4.2.

UH, REAL-TIME, CO-OP OPTIMIZATION UPDATE.

JP, IT'S OVER TO YOU.

GOOD MORNING.

GOOD MORNING.

THAT'S BETTER.

SORRY, JUST A SECOND.

OKAY.

BACK FURTHER TO THE FIRST, UH, UM, COMMITTEE MEETING THIS YEAR.

SO, SO FOR 2024, UM, ONE OF THE FIRST THING I WANT TO HIGHLIGHT IS THAT THIS YEAR WE ARE INCREASING OUR DELIVERY THROUGHPUT WITH 11 RELEASES IN A YEAR.

INSTEAD OF A STANDARD SIX, WE HAD 6, 4, 6 RELEASES IN A YEAR FOR SOME TIME.

SO THIS YEAR WE ARE BUMPING IT UP TO 11.

AND THE GOAL PRIMARILY THIS YEAR IS TO REDUCE THE NUMBER OF WHAT WE CALL OFF-CYCLE RELEASES OR CANADA.

IT'S SLIGHT LITTLE BIT UNPLANNED, BUT NOT REALLY, BUT STILL IT'S NOT A REGULAR SCHEDULE.

SO THAT'S ONE OTHER THING WE ARE IMPROVING ON.

UM, THIS YEAR WE ARE ALSO FOCUSED ON SHORTENING THE SITE FAILOVER THAT WE DO, WHERE WE DO IT OVER THE TIME.

WE HAVE BEEN DOING IT OVER FOUR DAYS, BUT IN REALITY, THERE'S A PRODUCTION ISSUE.

YOU NEED TO DO IT IN ONE DAY.

SO ONE THING WE ARE TRYING TO DO IS, YOU KNOW, TRAIN LIKE YOU'RE FIGHTING OR, YOU KNOW, PRACTICE WHAT YOU'RE EXPECTING TO DO.

SO THAT'S ONE OF THE THING THAT WE ARE DOING STARTING THIS YEAR.

AND UM, UM, AND JANUARY WAS THE FIRST OF THE 11 RELEASES.

JANUARY WAS THE FIRST OF THE SINGLE DAY SITE FAILOVER, AND IT ALL WENT WELL.

THERE'S STILL LESSONS LEARNED AS WE KEEP IMPROVING IT, BUT WE WANT TO GET TO THAT.

UM, AND I'LL TALK ABOUT THE TREASURY MANAGEMENT THAT WENT LIVE, THE PUBLIC API DATA PORTAL THAT WENT LIVE.

AND, UM, AND HIGHLIGHTS ARE OUR PROJECTS ARE GENERALLY ON TRACK WITH NORMAL UPS AND DOWN.

AND I'M GONNA START WITH THE PROJECT SLIDE FIRST.

OKAY.

SO WE HAVE, UH, 60 ACTIVE PROJECTS.

UM, AND THIS IS A NUMBER THAT YOU MAY HAVE HEARD ABOUT LAST YEAR TOO.

UH, WE, WE INITIATED FOUR NEW PROJECTS, UM, THIS YEAR AND TWO GOT CLOSED.

AND, YOU KNOW, JUST TO GET A VOLUME OF WHAT WE ARE LOOKING AT, UM, WE, UM, THE TOTAL BUDGET FOR THIS PROJECT IS ABOUT 167 MILLION OKAY, FOR SUMMIT ALL.

AND I TRIED TO PUT A BREAKUP OF WHAT THAT IS, UM, AND, AND YOU CAN SEE WHAT THE ACTUALS ARE TO DATE, AND THAT'S ON THIS COLUMN.

UM, AND, UM, AS WELL AS WHAT THE ESTIMATED COMPLETION IS.

OKAY, SO IF YOU ADD THE TOTAL, OKAY, YOU GET ABOUT 1 64 HERE.

AND, UM, WHAT THAT IS SHOWING IS THAT ACROSS ALL THESE 60 PROJECTS, WE HAVE ABOUT A 3 MILLION UNDERRUN.

OKAY? SO WE ARE DOING BETTER THAN WHAT

[00:05:01]

OUR BUDGET IS, BUT, BUT I JUST WANT TO SHOW SOME OF SOME CONTEXT AROUND SOME OF THESE NUMBERS.

AND ALSO THE 60 ACTIVE PROJECTS IN, I KIND OF DID A DISTRIBUTION ABOUT SMALL, MEDIUM LARGE AS WELL.

SO YOU CAN SEE WE HAVE A HEALTHY VOLUME OF PROJECTS THAT WE ARE RUNNING.

UM, ONE SIGN OF AN OUTLIER IS THIS LARGE HARDWARE NUMBERS THAT YOU SEE, HARDWARE AND SOFTWARE IS BECAUSE WE ARE RUNNING INFRASTRUCTURE PROJECTS THAT ARE NOT YET WIND IT DOWN.

SO WE'RE CARRYING SOME OF THAT, BUT ALSO OTHER PROJECTS LIKE THE EMS UPGRADE, UH, AS WELL AS, YOU KNOW, THE COST THAT WE ARE CARRYING FOR RTC, WHICH HAS ITS OWN SEPARATE SYSTEM THAT WE CUT OVER TO THAT HAS A HOW HUGE HARDWARE SOFTWARE COST AS WELL.

SO IT'S A LITTLE UNUSUAL BECAUSE OF THE KIND OF PROJECTS, BUT THAT'S WHY THE HARDWARE AND SOFTWARE NUMBER STANDS OUT.

UM, NEXT, UM, I'D LIKE TO TALK ABOUT, UM, OUR, UM, LABOR HOURS.

UM, AND WHAT I HAVE IS, YOU KNOW, I HAVE THIS LINE HERE ON THE LEFT.

WE HAVE ACTUALS AND WE HAVE FORECASTS FOR THE REST OF THE YEAR.

UM, AS YOU CAN SEE, OBVIOUSLY WE ARE PICKING UP PACE FROM THE VACATION AND HOLIDAY SEASON, SO THAT'S GOOD.

UM, OUR ACTUALS TEND TO BE A LITTLE BEHIND BECAUSE WE ALLOW LIKE A MONTH TO ENTER TIMECARDS.

SO, SO, SO, YOU KNOW, SO IT'S ALWAYS A LITTLE BEHIND WHEN I SHOW THE ACTUALS, BUT WHAT I INTEND TO DO GOING FORWARD IS TO SHOW THE FORECAST AND ACTUALS AND THE DEVIATION FROM FORECAST IN THE, FROM STARTING THIS.

SO THIS IS MY BENCHMARK RIGHT NOW.

EVERY TIME I COME HERE, I WOULD LIKE TO ALSO SHOW YOU WHAT THE DEVIATION IS.

OKAY? AND, AND SO THAT WE CAN WORK BETTER ON SOME OF THAT, UM, FORECASTING, UM, AND RESOURCE MANAGEMENT THAT WE NEED TO DO.

NOW IN THIS SLIDE, UM, I SHOULD ALSO MENTION THAT WE DO HAVE A ROAD MAPPING PROCESS TWICE A YEAR.

AND THAT'S WHEN WE IDENTIFY, ESPECIALLY THINGS LIKE, UM, UH, SOFTWARE AND HARDWARE THAT ARE GOING OUT OF DATE AND THAT GETS IDENTIFIED AND ADDED.

SO, SO, YOU KNOW, IT'S THIS BLUE LINE THAT GOES DOWN REALLY MAY COME START COMING UP AND THAT'LL LIFT THE WHOLE THING UP.

OKAY? SO, SO THERE IS, UM, THAT, BUT THAT'S JUST BECAUSE WE HAVEN'T RECORDED THAT FORECAST INTO OUR SYSTEM YET.

BUT, BUT YOU CAN SEE FROM THE PAST THAT IT'S ACTUALLY, YOU KNOW, YOU CAN SEE THAT HOW IT'S HIGHER.

UH, SO NO CONCERNS OVERALL.

LET ME KNOW IF YOU HAVE ANY QUESTIONS ON THIS.

NOW, AS I DO IN THESE PRESENTATIONS, I DO WANT TO GIVE AN, UM, UPDATE OF WHAT GOT RELEASED THIS YEAR AND, AND I'LL TALK, UH, MORE ABOUT, UM, THE TREASURY MANAGEMENT AND THE PUBLIC, API EXPLICITLY IN MY FOLLOWING SLIDES.

AND, UH, AGAIN, AS I DO ALWAYS, I GIVE A PREVIEW OF WHAT SHOULD BE RELEASED, UM, IN THE NEXT CYCLE.

SO, AND I'LL TALK MORE ABOUT THEM IN THE NEXT MEETING.

UM, A COUPLE OF INTERESTING ONES FOR THE MARKET PERSPECTIVE IS THE MMS OS MIGRATION, WHERE WE ARE UPGRADING THE HARDWARE AND WE ARE LOOKING AT ABOUT A 40% PERFORMANCE IMPROVEMENT WITH THAT.

SO, SO THAT'S A GOOD ONE TO COME TO AND, AND TALK ABOUT IT.

I'M ALSO EXCITED ABOUT THE DEVELOPER PORTAL.

WHEN I SAY DEVELOPER, I MEAN SOFTWARE DEVELOPER NOT, UM, A RESOURCE DEVELOPMENT.

UM, SO THE IDEA HERE IS TO PROVIDE A SINGLE PORTAL WHERE PEOPLE CAN, YOU KNOW, SEE EXAMPLE CODES, UH, GOOD DOCUMENT FULL LATE, I MEAN UP TO DATE DOCUMENTATION, HAVE A PLACE WHERE THE MARKET PARTICIPANTS CAN HAVE FEEDBACK AND A DISCUSSION LIKE STACK OVERFLOW IF I CAN GIVE A REFERENCE, UM, AND, AND CAN HAVE A DISCUSSION GROUP.

AND, AND WE ARE MISSING ALL THAT DEVELOPER INTERACTION AND THIS DEV DEVELOPER PORTAL AIMS TO DO THINGS ABOUT THAT.

SO THAT'S SOMETHING I'M EXCITED ABOUT.

JP, DOES THAT INCLUDE THE TEST SYSTEM THAT WE TALKED ABOUT AT A PREVIOUS MEETING? THE WHAT SYSTEM? THE TEST SYSTEM? NO, THIS DOES NOT INCLUDE THE TEST SYSTEM.

THIS, THIS, SO THIS IS JUST THE DEVELOPER ENVIRONMENT? YEAH, JUST THE DEVELOPER.

YEAH.

UM, OKAY, SO THE TREASURY MANAGEMENT SYSTEM.

UM, SO WHAT THE SYSTEM DOES IS IT USES MACHINE LEARNING IN THE ACCOUNT RECEIVABLE FOR INVOICE MATCHING.

AND WHAT THE TREASURY MANAGEMENT TEAM USED TO DO IS, YOU KNOW, DO THIS WORK MANUALLY.

AND YOU CAN IMAGINE DURING URI AND OTHER SIGNIFICANT EVENT, THERE'S A LOT OF WORK THAT THIS TEAM HAS TO DO.

UM, AND WHEN WE PUT THIS PROJECT ONLINE, WE SAW, YOU KNOW, THERE WERE ABOUT, UM, IN A YEAR, YOU KNOW, THEY DO ABOUT 8,000 WIRES.

AND SO FAR WHAT WE HAVE FOUND, OKAY, SINCE

[00:10:01]

WE WENT LIVE, THERE WAS 8,000 WIRES, ABOUT 700 MILLION US DOLLARS AND WIRES AND, UH, COLLATERALS THAT CAME IN.

AND FOR THESE 8,000 WIRES AND COLLATERAL, THE SYSTEM WAS ABLE TO MATCH 96% OF IT, OKAY, WITH THIS MACHINE LEARNING AI TECHNOLOGY, RIGHT? AND THAT IS THE AMOUNT OF MANUAL WORK THAT IS AVOIDED BY USING THIS TECHNOLOGY.

UM, NOW FOR THE REMAINING 4% WHERE IT DIDN'T GET MATCHED, YOU KNOW, THE SYSTEM, BECAUSE IT'S A LEARNING SYSTEM, IT KEEPS LEARNING LIKE WHY COULDN'T IT MATCH AND GETS IMPROVED.

IN FACT, YOU CAN SEE THAT WHEN I CREATED THIS BOARD SLIDE, I WAS AT 95% AND I'M REPORTING 96% ALREADY.

SO, SO THIS HAS BEEN A GREAT IMPROVEMENT AND, UM, ELIMINATES MANUAL WORK FOR OUR TEAM.

SO, UM, I'M EXCITED AND THE TREASURY MANAGEMENT TEAM IS ECSTATIC.

UM, ANOTHER RELEASE I'M ALSO EXCITED ABOUT IS THE PUBLIC API PORTAL.

UH, WHAT WE DID IS WE HAVE, WE TOOK THE, YOU KNOW, WE HAVE A 200 PLUS PUBLIC REPORTS, UM, AND WHAT HAPPENS, EVEN FOR THE REST OF IT THAT WE DON'T HAVE THE API IS IF YOU WANT DATA FROM ERCOT, YOU HAVE TO CALL OR USED TO BE THAT USED, YOU HAD TO CALL CLIENT SERVICES, THEY'D CALL IT, AND SOMEBODY MANUALLY CURATE THE DATA, PUT IT ON A ZIP DESK AND SHIP IT, AND THIS WHOLE PROCESS COULD TAKE A MONTH.

YOU KNOW, IT'S JUST THE NATURE OF THIS RIGHT NOW.

IN THE MEANTIME, WE HAVE MADE SOME IMPROVEMENTS SO THAT YOU CAN DIRECTLY GET THE REQUEST TO IT AND ELIMINATE SOME OF THE MANUAL WORK.

BUT WHAT THIS PROJECT DOES IS MAKE IT A SELF SERVE SO THAT IF YOU WANT DATA, YOU JUST WRITE YOUR API AND GET IT RIGHT AWAY.

THERE'S NO HUMAN INTERACTION NEEDED OR WAITING ANYMORE OR THINGS LIKE THAT.

SO, SO THIS IS OUR FIRST, UH, CLOUD APPLICATION THAT WE BUILT AT .

SO, SO WE HAD A BIT OF LEARNING TO DO AND THINGS LIKE THAT.

BUT NOW THAT THIS IS IN PLACE, WE WANT TO GET GOING ON THE REST OF THE, UM, PUBLIC REPORTS AND HOPEFULLY DOWN THE LINE WE WORK ON SECURE DATA AS WELL USING SIMILAR, UM, MODERN API TECHNOLOGIES.

I ALSO WANT TO TALK ABOUT AN INCIDENT THAT WE UNCOVERED THIS YEAR AND, AND THIS INCIDENT RELATES TO, UM, THE RATINGS FOR A SUBSET OF OUR BRANCHES.

OKAY? SO IN THIS CASE, WE HAVE ABOUT 10,500 BRANCHES IN OUR MODEL.

WHEN I SAY A BRANCH, IT COULD BE A LINE, IT COULD BE A SERIES DEVICE, A TRANSFORMER FACIAL TRIM, ANY OF THOSE THAT CONNECTS TWO NODES.

OKAY? SO WE HAVE ABOUT 10,500 BRANCHES, AND WE FOUND THAT OUT OF THESE, THE STATIC RATING FOR ABOUT 40 OF THEM WERE MISMATCHED.

OKAY? AND, UM, SINCE, UH, THE EMS GO LIVE, OKAY? UM, THE, THE, SO WE MAY, WE WILL HAVE A PRICE CORRECTION THAT WE'LL BRING TO THE BOARD AND, AND, AND KENNAN WILL TALK ABOUT IT IN HIS SLIDES, BUT WE DON'T HAVE THE NUMBER YET, SO IT'LL COME IN APRIL, BUT I DON'T GIVE YOU A HEADS UP ON THAT.

NOW, THE ROOT CAUSE IS THAT ON THE EMS, THERE'S A FLAG THAT IS, THAT IS A DEFAULT VALUE FOR THE VENDOR, BUT IN OUR SYSTEM, THE FLAG IS FLIPPED, OKAY? AND, UM, AND WE DIDN'T SEE IT BECAUSE THIS COMES IN INFREQUENTLY, RIGHT? IT'S ONLY WHEN A MODEL DATA COMES IN.

AND, AND IT'S ALSO NOT FOR, IT'S ALSO FOR A SUBSET OF LINES, SOME KIND OF LINES WHERE WE DON'T HAVE WHAT YOU CALL DYNAMIC RATINGS.

UM, AND IT'S ONLY FOR THESE LINES THAT HAVE STATIC RATING.

THAT'S WHY IT WAS A LITTLE HARD TO CATCH IT.

UM, BUT NEVERTHELESS, ONCE IDENTIFIED, WE, WE ARE ABLE TO QUICKLY FIX IT.

AND, AND ALSO AS PART OF THE LESSONS LEARNED IN CORRECTION, WHAT WE'RE GOING TO DO IS, AND WE ARE WORKING ON IT, IS THAT AS PART OF THE WEEKLY MODEL LOAD THAT WE DO, WE WANT TO HAVE SCRIPTS THAT COMPARES WHAT WE EXPECT TO PUT IN AND WHAT IS ACTUALLY IN THE SYSTEM.

SO, SO, SO IN A WAY, YOU KNOW, THERE'S NOT JUST AN EM OKAY? UM, NO.

WHEN I JOINED ERCOT IN 2020, OUR SCHEDULE GO LIVE FOR THE EMS WAS, UH, JUNE OF 2024.

OKAY? AND, AND QUITE UNDERSTANDABLY,

[00:15:01]

BECAUSE WE WERE MIGRATING OUR NETWORK MODEL FROM, WHAT DO YOU CALL SIM 10 TO SIM 16, WE WERE MIGRATING FROM FOUR TRAN TO C PLUS PLUS, WHICH MEANS WE HAD TO REWRITE A LOT OF OUR CRITICAL APPLICATIONS FROM FOUR TRAN TO C PLUS PLUS.

AND IT ALSO MEANT THAT ANY SIGNIFICANT WORK THAT WE WERE DOING, LIKE ECRS, WE HAD TO IMPLEMENT IT IN ONE SYSTEM IN OUR CURRENT SYSTEM, OR I SHOULDN'T SAY CURRENT IN OUR PREVIOUS SYSTEM, AND THEN REIMPLEMENT IT IN THE NEW SYSTEM, RIGHT? SO THERE IS SIGNIFICANT AMOUNT OF WORK.

SO WHAT WE WERE TRYING TO DO IS SHIFT FROM THIS RISK HOURS METHOD, RIGHT? TO DELIVER AS LATE AS POSSIBLE TO SHIFT, TO DELIVER AS EARLY AS POSSIBLE.

AND IT'S NOT JUST IN THE EMS, RIGHT? I MEAN, AND YOU CAN SEE ACROSS THE BOARD, I'M TRYING TO DO THAT WITH IT, AND YOU CAN SEE THAT TODAY ITSELF, RIGHT? WE TALKED ABOUT GOING FROM SIX RELEASES TO 11, UM, GOING FROM A FOUR DAY SITE FAIL OVER TO ONE.

THE TREASURY MANAGEMENT SYSTEM THAT I TALKED ABOUT, UM, ORIGINALLY, YOU KNOW, WE WERE THINKING WE WILL DO IT AFTER RTC AND WE, AND WE ARE LIVE NOW, AND TEAM CAN BENEFIT FROM THAT.

UH, WE CONSOLIDATED HARDWARE WHERE BECAUSE OF THE CONSOLIDATION, THE RTC COST DID NOT GO UP, IN FACT, IT DROPPED, RIGHT? AND, AND WE HAVE SIGNIFICANT CHANGES COMING DOWN THE LINE, ESPECIALLY WITH GREAT TRANSFORMATION AS WELL AS OTHER TECHNOLOGY ADVANCES, OKAY? AND IT'S ALSO THIS CHANGE IN CULTURE THAT ALLOWS ME TO ASK MY TEAM, WHY SHOULD FOR 26 IN FOR RTC, WHY NOT TRY TO BRING IT IN EARLIER FOR 25? OKAY? SO MY POINT IS I WANT TO KEEP PUSHING FOR, UH, THIS CULTURE CHANGE TO DELIVER EARLIER.

AND, YOU KNOW, SOMETIMES THINGS LIKE THIS HAPPEN, RIGHT? BUT IT'S A RISK-BASED ASSESSMENT THAT WE NEED TO DO.

UM, AND, BUT I'M NOT TRYING TO SAY THAT, YOU KNOW, UNDERMINE QUALITY OR TESTING, BUT I DO WANT TO POINT OUT THAT I'M TRYING TO SHIFT PEOPLE TO DELIVER EARLIER AND THESE KIND OF THINGS MAY HAPPEN.

UM, AND FROM THAT PERSPECTIVE, I DO WANT TO CONGRATULATE AGAIN THE EMS TEAM FOR DELIVERING IT, YOU KNOW, SEVEN MONTHS EARLIER THAN PLANNED BEFORE.

SO, BUT I KNOW YOU PROBABLY HAVE QUESTIONS ON THIS, SO I'LL PAUSE HERE FOR A MINUTE TO SEE IF YOU HAVE INSTANCE.

ANY QUESTIONS OR COMMENTS ON THIS? NO.

WELL, MY, FIRST OF ALL, I WANT TO APPLAUD YOU ON THE THINGS YOU'VE RELEASED AND, AND I HOPE THAT IN FUTURE MEETINGS FOR THE LAST THREE TOPICS, UH, THE DEVELOPER PORTAL AND TREASURY MANAGEMENT SYSTEM, ET CETERA, YOU'LL SHOW US THE, UH, USAGE RATE AND HOW IT'S BEING ADOPTED BY THE USERS ON THIS PARTICULAR TOPIC.

I MEAN, IN GENERAL, I, I DON'T QUITE UNDERSTAND THE QUALITY MANAGEMENT SYSTEM IN ERCOT, AND I'D LIKE A LITTLE BIT MORE UNDERSTANDING OF THAT.

IN THE FUTURE MEETINGS, EVERY OPERATION HAS ONGOING ERROR RATES.

WE GET TO, WE HAVE MORE OF A COMPLIANCE MENTALITY HERE IN THE BOARDROOM WHERE WE JUST SEE EXCEPTIONS THAT CROSS A CERTAIN THRESHOLD.

WHAT I'D REALLY LIKE TO SEE AT A FUTURE MEETING WITH THE CHAIRMAN'S AGREEMENT IS SOME ONGOING ERROR RATES AND THE CULTURE, WORK CULTURE THAT'S WORKING ON CONTINUOUS IMPROVEMENT OF DRIVING DOWN THOSE ERROR RATES.

YES, IT'S GOOD TO SEE THESE EXCEPTIONS THAT GET RAISED TO THE BOARD LEVEL, BUT I'D LIKE TO UNDERSTAND OPERATIONALLY OUR QUALITY LEVEL.

YEAH, AND THAT'S A GOOD POINT, RIGHT? WE JUST TEND TO TALK ABOUT THINGS THAT WE DIDN'T CATCH, BUT IT MIGHT BE USEFUL TO SEE WHAT IS IT THAT WE ARE CATCHING AND IMPROVING OURSELVES, RIGHT? I THINK OTHERWISE WE'LL GIVE YOU LIKE A BIASED VIEW OF WHAT IS HAPPENING.

I AGREE WITH THAT.

SO I'LL BRING FORWARD SOME OF THAT IN FUTURE THINGS AS WELL.

OKAY.

YOU KNOW, AND, BUT THAT'S KIND OF THE THING THAT HAPPENS, RIGHT? WHEN YOU DO IT, IT FEELS LIKE, YEAH, BUT THAT'S YOUR JOB.

BUT SOMETIMES IT'S IMPORTANT TO SHOW THAT AS WELL.

I AGREE WITH YOU.

OKAY.

SO I, GOOD POINT.

I'LL DO THAT.

YEAH, ACTUALLY TO MAKE, SO TO ADD TO THAT, TO MAKE A RECOMMENDATION, BECAUSE WHAT WE'RE NOT LOOKING FOR IS AN EXTENDED PRESENTATION OR IN-DEPTH REVIEW, YOU SHOULD PROBABLY HAVE A, YOU PROBABLY HAVE A DASHBOARD THAT SHOWS THE METRICS THAT YOU'RE MEASURING.

MM-HMM.

.

AND JUST SHOWING THAT ONE SLIDE DASHBOARD WITHOUT A LOT OF EXPLANATION WILL GIVE US A SENSE OF, ALRIGHT, WHAT'S GOING ON? AND THEN YOU HAVE YOUR EXCEPTIONS.

SOUNDS GOOD.

I'LL, I'LL, I'LL WORK ON THAT.

CARLOS MAIN QUESTION IS ABOUT STAFFING AND, UH, 'CAUSE 30 MILLION TO GO, UH, FOR YOUR FORECAST FOR THE YEAR.

UH, DO YOU HAVE THE ADEQUATE, ADEQUATE RESOURCES FOR THAT AT THIS POINT? YES.

AT LEAST ON IT.

YES.

UM, I THINK, UM, WE HAVE SOME OPEN POSITIONS UNDER WOODY THAT NEEDS TO BE FILLED, BUT, UM, BUT IF YOU LOOK AT IT FROM AN IMPLEMENTATION PERSPECTIVE ON IT SIDE, I THINK, UM, WE HAVE SOME OPEN POSITIONS, BUT GENERALLY, I'M NOT SAYING WE HAVE A PROBLEM

[00:20:01]

AND SOME THINGS ARE AT RISK.

JUST, JUST TO FOLLOW ON, ON THAT, ON THAT POINT, I MEAN, GI GIVEN THAT PEOPLE COME IN UNITS OF ONE, UM, THE FLUCTUATION IN YOUR WORKLOADS FROM MONTH TO MONTH ON THREE OR FOUR SLIDES BACK, UM, HOW, HOW DO YOU BALANCE THAT FLUCTUATION? MOST OF THE TIME WHAT PEOPLE DO IS USE CONTINGENT LABOR TO DO THAT, BUT DOESN'T APPEAR THAT YOU'RE DOING THAT GIVEN CONTINGENT LABOR IS FAIRLY FLAT.

SO HOW SHOULD WE INTERPRET THIS? DOES THIS IMPLY THAT THERE'S, YOU KNOW, 5,000 PERSON HOURS WORTH OF WORK THAT PEOPLE ARE JUST SITTING ON THEIR BUMS FOR A WHILE OR ? SO, SO HERE'S THE DIFFERENCE BETWEEN LET'S SAY ACCENTURE OR SIEMENS OR THOSE KIND OF, AND WHERE WE HAVE DEDICATED PEOPLE DOING PROJECTS.

OKAY? I DON'T HAVE DEDICATED PEOPLE DOING PROJECTS.

THAT MEANS PEOPLE DOING THEIR DAY TO DAY JOB AND SOME ALLOCATED AMOUNT OF THEIR TIME, THEY'RE DOING PROJECTS.

SO, UM, AND IT'S NOT LIKE PROJECTS IS ALWAYS A TOP PRIORITY, RIGHT? LIKE, FOR EXAMPLE, IF I HAVE THIS EMS RATING ISSUE, THEY MAY BE ON A PROJECT, BUT THEY'LL LOOK AT THE RATING ISSUE THAT NEEDS TO BE SOLVED.

OKAY? BUT WHICH MEANS THAT YOU CAN'T HAVE ISSUES ALL THE TIME, THEN, THEN I'LL HAVE A PROBLEM WITH PROJECTS.

SO IN GENERAL, WITH RESOURCE MANAGEMENT, WE ARE COMMITTING TO RESOURCES, A PERCENTAGE OF THE RESOURCES, TIME ON THE PROJECTS AND, AND THE MIX OF WORKING ON THE REAL SYSTEM AS WELL AS WORKING ON PROJECTS MAKE, MAKE SURE THAT, YOU KNOW, YOU'RE NOT INTRODUCING SOMETHING THAT IS NOT OPERATIONALLY VIABLE OR SOMETHING LIKE THAT.

BUT THE POINT, THE UNDERLYING POINT IS THAT I DON'T HAVE FULL-TIME PROJECT RESOURCES.

SO I THINK IT WOULD BE HELPFUL FOR US TO SEE SORT OF HOW THIS FITS AGAINST THE TOTAL RESOURCE POOL.

UM, SO GIVE US A, A VIEW OF IF THE TOTAL RESOURCE POOL, I'M MAKING THIS UP, IS 25,000 LABOR HOURS, UH, IN A MONTH.

I MEAN, HOW, HOW DO YOU THEN BALANCE PROJECTS VERSUS OTHER THINGS? I THINK THAT WOULD BE MOST USEFUL.

YEAH.

OKAY.

I I'LL GO THROUGH IT EXPLICITLY, BUT AT A HIGH LEVEL, WHAT WE DO IS WE MAKE A MONTHLY PLAN ON WHAT IS UPCOMING, WHAT IS IN THE PROJECT LIST THAT IS IN THE SCHEDULE.

AND THEN WE MAKE A COMMITMENT THAT THAT'S THE WORK THAT NEEDS TO BE DONE.

AND THAT'S WHAT DRIVES SOME OF THE FORECAST.

AND SO THE FORECAST TENDS TO BE MORE ACCURATE FOR THE MONTH, BUT THEN IT GETS BAD AFTER THAT BECAUSE NOBODY'S REALLY PLANNED FOR THAT.

BUT THAT'S GENERAL HIGH LEVEL VIEW.

OKAY.

WELL, YEAH, SO, SO GO AHEAD.

I JUST THINK WE'RE LOOKING FOR A PIE CHART, A PIE CHART.

YOU'RE JUST TRYING TO UNDERSTAND PERCENT OF TOTAL.

THAT'S I THINK WHAT THE AND I'LL GO EXPLAIN THAT AS WELL.

IT'D BE A GOOD, BE A GOOD SESSION.

OKAY.

AND IF THERE ARE NO MORE QUESTIONS, I WANT TO MOVE TO THE MOST EXCITING PART OF THIS PRESENTATION, WHICH IS THE ERCOT INNOVATION SUMMIT.

AND FOR THAT, UM, I'M GOING TO INTRODUCE PATHY IN HIS NEW ROLE AS VP FOR DEVOPS AND GREAT TRANSFORMATION.

AND I'LL LET T TALK ABOUT THAT.

OKAY.

AND I'LL BRING IT TO THE SLIDE.

THANK YOU JP.

UH, GOOD MORNING COMMITTEE MEMBERS AND GUESTS.

UH, AS JP SAID, YES, I AM ACTUALLY EXCITED ABOUT TALKING, UH, ABOUT THE AIR AIRPORT INNOVATION SUMMIT.

THIS IS, UH, THE FIRST TIME WE ARE DOING SOMETHING LIKE THIS.

THIS IS THE FIRST SUMMIT WE ARE HOSTING, AND, UH, THERE ARE FOUR MAIN REASONS WHY WE WANTED TO HOST A SUMMIT.

THE FIRST ONE IS ABOUT AWARENESS.

WE WANTED TO BRING AWARENESS TO THE INDUSTRY ON THE TOPICS AND THEMES THAT WE FELT ARE IMPORTANT AS THE GRID TRANSFORMS. THE SECOND ONE IS ABOUT SHARING.

WE WANTED TO TALK ABOUT THE OPPORTUNITIES AND CHALLENGES WITH THESE TOPICS AND THEMES AND SHARE OUR PERSPECTIVE FROM OUR VANTAGE POINT.

THE THIRD ONE IS ABOUT LEARNING.

WE WANTED TO LEARN FROM THE PARTICIPANTS, UH, THEIR PERSPECTIVES, FROM THEIR VANTAGE POINTS, UH, BRAINSTORM POTENTIAL SOLUTIONS AND GET SOME FEEDBACK.

AND THE LAST ONE IS ABOUT INSPIRING.

WE REALLY WANTED TO INSPIRE MORE RESEARCH AND INNOVATION, UH, ON THE PROBLEM AREAS THAT WE IDENTIFIED.

SO AGAIN, FOUR MAIN REASONS, UH, AWARENESS, SHARING, LEARNING, AND INSPIRING WITH THE REASONS FOR THE SUMMIT.

UH, OUR TAGLINE IS USING INNOVATION TO IMPACT TRANSFORMATION USING INNOVATION TO IMPACT TRANSFORMATION, RIGHT? AND, UH, WE ARE GONNA HAVE SIX PANELS.

UM, WE ARE STRIVING HARD TO MAKE SURE THAT, YOU KNOW, WE HAVE A HETEROGENEITY IN THE, THE PANELISTS IN TERMS OF GETTING FOLKS FROM THE INDUSTRY, UH, GETTING FOLKS FROM ACADEMIA, MAYBE GETTING FOLKS FROM THE RESEARCH, YOU KNOW, NATIONAL LABS AND THINGS LIKE THAT.

UH, WE WILL MAKE ANNOUNCEMENTS AS WE LOCK IN THE PANELISTS FOR THESE PANEL SESSIONS.

UM, AS, AS WE GO ALONG, WE ARE ALSO STRIVING TO MAKE SURE THAT WE GET A, A KEYNOTE SPEAKER

[00:25:01]

FOR THE SUMMIT, UH, WHO IS WITHIN THE RESEARCH AND INNOVATION SPACE, UH, WITHIN OUR SECTOR, RIGHT? UH, THE FIRST PANEL WILL BE ON ESSENTIAL RELIABILITY SERVICES.

UH, FRED WONG, WHO IS OUR DIRECTOR OF, UM, OPERATIONS SUPPORT, UH, WILL BE LEADING THAT PANEL AND THEY'LL BE FOCUSED ON THE CHANGING RESOURCE MIX IN THE GRID AND HOW DOES IT IMPACT FREQUENCY CONTROL, HOW DOES IT IMPACT VOLTAGE CONTROL SYSTEM STRENGTH, SYSTEM INERTIA, ET CETERA.

UH, THE SECOND PANEL WILL BE ON UNCERTAINTY MANAGEMENT.

JEFF BELOW, WHO IS OUR DIRECTOR OF OPERATIONS PLANNING, WILL BE LEADING THAT.

UM, THEY WILL BE TALKING ABOUT VARIABILITY UNCERTAINTY ASSOCIATED WITH, YOU KNOW, SEVERAL THINGS ON THE GRID AND, UH, MAYBE SOME PROBABILISTIC RISK ASSESSMENT, ET CETERA.

THE THIRD PANEL WILL BE ON DEMAND FLEXIBILITY.

UM, DAVE MAGGIO, WHO IS OUR PRINCIPAL IN THE COMMERCIAL OPERATIONS SPACE, UH, WILL BE LEADING THAT PANEL.

AND, UH, THEY WANT TO TALK ABOUT HOW TO LEVERAGE THE DEMAND SIDE OF THE SUPPLY AND DEMAND EQUATION, UH, FOR IMPROVING THE GRID OPERATIONS AND MARKET OPERATIONS.

UH, THE FOURTH PANEL WILL BE ON TRANSMISSION PLANNING.

PRAM, WHO IS OUR DIRECTOR OF TRANSMISSION PLANNING.

UH, WE'LL BE TALKING ABOUT SORT OF THE PARADIGM SHIFT THAT IS NEEDED IN THE PLANNING WORLD AS THE GRID TRANSFORMS. UH, THE FOURTH, THE FIFTH PANEL WILL BE ON, UH, ENERGY STORAGE RESOURCES.

KENNETH RAGSDALE, WHO IS OUR PRINCIPAL OF MARKET DESIGN AND ANALYSIS, WILL BE LEADING THAT PANEL.

UH, THAT PANEL WILL FOCUS ON THE, THE PROLIFERATION OF ENERGY STORAGE RESOURCES IN THE TEXAS GRID AND, UH, HOW FAST THE TECHNOLOGY IS CHANGING, UH, WITH ENERGY STORAGE AND ALL THE OPPORTUNITIES AND CHALLENGES WITH THAT.

AND THE LAST PANEL WILL BE LED BY AJAY MANOLI, WHO IS OUR DIRECTOR OF IT STRATEGY AND ARCHITECTURE.

THEY'LL BE TALKING ABOUT DATA, AI, ML TECHNOLOGIES TO SORT OF SOLVE THE, THE BUSINESS PROBLEMS, RIGHT? THE SORT OF BREAKTHROUGHS THAT ARE HAPPENING AT A RAPID PACE ON THE A ML WORLD.

AND WE WANT TO CAPTURE SOME OF THOSE TOPICS, RIGHT? SO WE HAVE SIX PANELS.

ALL, ALL TOPICS ARE REALLY APT TO WHAT'S HAPPENING WITH THE, WITH THE GREAT TRANSFORMATION.

ON THE LOGISTICS SIDE, UH, WE REALLY WANTED TO WELCOME ALL THE PARTICIPANTS TO OUR PREMISES HERE IN THE MED CENTER.

AND, UH, WE THOUGHT OF HAVING ABOUT 200, YOU KNOW, UH, ATTENDEES FOR THE SUMMIT.

AND, UH, WHEN WE RELEASED THE, THE MARKET NOTICE, AND THAT'S THE ONLY THING WE RELEASED ABOUT THE SUMMIT WITHIN A DAY OR TWO, WE WERE FULL.

AND, UH, THE WAIT LIST IS ACTUALLY GROWING DAY BY DAY AS WE SPEAK.

AND SO NOW WE ARE TRYING TO FIGURE OUT THE FEASIBILITY OF, UH, LOOKING AT A HOTEL THAT IS CLOSE BY, UH, THAT WE COULD HOST.

UH, WE ARE ALSO EXPLORING SOME OPTIONS WITH LIVE STREAMING.

AND, UM, I WILL SHARE MORE INFORMATION AS, AS IT COMES ALONG.

HOPEFULLY WITHIN A, WITHIN A COUPLE OF WEEKS WE CAN, WE CAN SORT ALL THAT OUT.

UH, SO WITH THAT, I WILL, I WILL PAUSE AND I WILL TAKE ANY QUESTIONS ON THE SUMMIT.

I I HAVE ONE MORE, MORE COMMENT THAN QUESTION, UM, IN YOUR OBJECTIVES FOR THE SUMMIT, UH, I, I WOULD LIKE TO SORT OF ADD THE OBJECTIVE OF, UH, ERCOT THOUGHT LEADERSHIP, UM, IN THIS WHOLE AREA BECAUSE AS, AS I THINK WE'VE SEEN THERE, THERE'S A LOT OF MISINFORMATION OR PARTIAL INFORMATION ON ALL OF THESE TOPICS THAT'S FLOATING AROUND HERE.

UM, AND I THINK THIS IS A CHANCE FOR ERCOT TO ESTABLISH ITSELF AS SORT OF THE CANONICAL PLACE WHERE PEOPLE CAN COME AND GET TRUSTED INFORMATION.

UM, SO JUST ADD IT AS A FIFTH OBJECTIVE FOR YOUR, UM, OR CONSIDER ADDING IT AS A FIFTH OBJECTIVE, UH, FOR, FOR YOUR SESSION.

I THINK, I THINK IT'S GREAT YOU'RE GETTING SO MUCH, UH, DEMAND FOR THIS.

I THINK IT'S, UH, IT'S INDICATIVE OF THE FACT THAT THE MARKET IS HUNGRY FOR THIS KIND OF INFORMATION.

YEAH.

THANK YOU JOHN.

YEAH.

ANYTHING ELSE? THANK YOU.

BACK TO YOU JP.

ONE, ONE QUESTION.

I MEAN, ALL OF THESE THEMES SOUND LIKE OPTIMIZATION, RIGHT? OF THE GRID.

UM, ARE YOU GONNA TALK ABOUT AI SYSTEMS, FOR EXAMPLE, WHICH IS SOMETHING OTHER GRID, UH, OPERATORS ARE DOING AND HOW THAT PHASES INTO ALL OF THESE? YES, ACTUALLY THE TECHNOLOGY TRENDS PANEL IS GOING TO BE TALKING ABOUT AI AND ML AND HOW WE COULD LEVERAGE THE BREAKTHROUGHS, UH, IN THAT TECHNOLOGY TO ASSIST WITH THE BUSINESS USE CASES.

AND ONE OF THE PANELISTS THAT WE ARE AIMING FOR IS, UH, UH, ANOTHER ISO AND WE WANT TO SHOWCASE SOME OF THE THINGS THAT THEY'RE DOING.

YES, FOR SURE.

ALRIGHT, THANK YOU.

CAN'T ESCAPE THE AI ML TOPIC.

SO THIS IS MY LAST SLIDE ON THIS, UH, DECK.

UM, JOHN, IF YOU OKAY, IF YOU'RE GOOD, I CAN START WITH THE NEXT ONE.

THANK YOU.

OKAY.

UH, THE NEXT STOP IS ITEM 4.3, WHICH IS PUR UPDATE, WHICH IS, CAN BE PRESENTED BY BETTY DAY.

JOHN 4.2

[00:30:01]

FOR RTC.

I'M SORRY.

YOU'RE RIGHT.

OKAY.

4.2 FOR RTC.

[4.2 Real-Time Co-Optimization Implementation Update]

ALRIGHT.

UM, SO AGAIN, UM, STARTING DECEMBER WHAT WE WANTED TO DO WAS TO GIVE A PERIODIC UPDATE ON RTC UNTIL WE GET THERE.

SO, SO THIS SLIDE IS UNCHANGED FROM MY PREVIOUS DECEMBER SLIDE, BUT I WANT TO JUST RECOGNIZE THAT NPR R 1 0 2 4 IS APPROVED.

UH, NOW FROM A REQUIREMENTS PERSPECTIVE, UH, IT IS POSSIBLE THAT WE MAY NEED MORE NPRS, BUT THERE MAY BE MORE ABOUT CLEANUPS AS WE GO THROUGH THE DESIGN AND YOU FIND THAT, OKAY, THIS IS WHAT WE NEED TO DO, BUT THE PROTOCOLS SAY OTHERWISE.

SO THERE MAY BE SOME KIND OF CLEANUP PRO, UH, NPRS THAT WE MAY DO.

UH, THE ONLY SIGNIFICANT ONE THAT I FEEL THAT WE ARE STILL DISCUSSING IS THE ROUGH CAPACITY SHORTFALL, AND THAT HAS STILL BEEN DISCUSSED IN THE RTCB TASK FORCE.

UM, AND, AND, UM, JUST COME IN AS ANOTHER NPRR WOULDN'T HAVE ANY IMPACT.

I DON'T HAVE A NUMBER YET ON THAT, BUT, BUT WHEN IT IS READY, I'LL BRING IT UP HERE AS WELL.

UM, THE ONLY THING I'LL REPEAT ON THIS SLIDE IS THAT THE BENEFIT TO THE MARKET IS UPWARD OF $130 MILLION EACH MONTH, OR I SEE THE COST OF NOT HAVING RTC EACH MONTH.

UM, AGAIN, FOR SOME OF THE NEW MEMBERS HERE, YOU KNOW, THIS PICTURE IS WHAT I ALSO USED LAST PRESENTATION TO KIND OF DESCRIBE HOW THE PROJECTS ARE SET UP.

AND SINCE I'LL BE REPORTING FROM A PROJECT PERSPECTIVE, UM, THIS SYSTEM KIND OF, THIS GROUPING OF SYSTEM KIND OF INDICATES WHAT THE PROJECTS ARE, RIGHT? AND ONE OF THE MAIN TAKEAWAY ON THIS SLIDE IS ALSO THAT IT'S NOT JUST THAT THE SYSTEMS ARE CHANGING, BUT THERE ARE MARKET PARTICIPANT SYSTEMS THAT ARE CHANGING AS WELL AND THEY NEED TO BE READY ALONG WITH US TO GO LIVE, RIGHT? SO IT'S NOT JUST THAT WE ARE ALL READY TO GO.

IF THEY'RE NOT READY WITH US, WE ARE STILL NOT THERE.

OKAY? SO IT'S SOMETHING TO KEEP IN MIND AND I'LL KEEP REMINDING AS WE GO THROUGH THESE SLIDES.

OKAY.

SO FROM, UM, PROJECT BUDGET, FINANCIAL PERSPECTIVE, WE ARE GOOD.

I MEAN, WE ARE ON TRACK.

UM, AS YOU SEE, THE DOLLARS ARE JUST TRICKLING IN AT THIS POINT, AND WE ARE GOING TO WE'LL SEE SIGNIFICANT, UH, RAMP UP, ESPECIALLY AS THE VENDORS WHO STARTED DEVELOPMENT STARTS, UH, INVOICING US, WHICH IS NOT REFLECTED AT THIS TIME IN MY SLIDES, JUST FROM A TIMING PERSPECTIVE.

AND, UM, OBVIOUSLY MOST OF THE SPEND AT THIS POINT IS IN THE PROJECT, UH, CONTROL PROJECT.

THE FIRST ONE, BECAUSE THAT'S THE PROJECT WE USED TO SPIN UP ALL THE OTHER PROJECTS.

SO THAT IS THE ONLY PLACE PEOPLE COULD CHARGE TO.

OKAY.

UM, SO NOTHING EXCITING AT THIS POINT HERE.

MORE TO COME.

UM, SO ON THIS SLIDE TWO, WE ARE GENERALLY MAINTAINING THE OVERALL FLOW THAT I PRESENTED IN DECEMBER.

UH, ONE PROJECT THAT HAS SHIFTED IS OUR EVER POPULAR 1, 1 8 6.

AND, UM, IT HAS A NEW GO LIVE DATE OF JUNE.

UM, IT'S NOT IMPACTING RTC, BUT UM, BUT IT'S NEVERTHELESS A CHANGE.

NOW AS FAR AS THE MAIN RTC PROJECT IS CONCERNED, UM, WE EXPECT TO RECEIVE FORMAL SCHEDULE FROM THE VENDOR MID-MARCH.

UM, AND UM, AS I MENTIONED, YOU KNOW, WE HAVE, IT COSTS US A LOT TO NOT HAVE RTC, RIGHT? SO IF I, IF I, IF THERE ARE IMPACTS THAT ARE COMING IN ANY WAY, I'LL COME BACK TO THE BOARD WITH OPTIONS OR ALTERNATIVES THAT WE CAN DO TO KEEP THE SCHEDULE AND ESPECIALLY SO THAT WE CAN GET TO THE MARKET TRIALS ON TIME.

AND, UM, AND, AND THEN OF COURSE THE GO LIVE.

UM, NOW I SPOKE ABOUT THE MARKET PARTICIPANT SYSTEMS AND, UM, IT'S IMPORTANT TO BRING THEM ALONG AS WELL.

SO WE HAVE A BUNCH OF INITIATIVES, YOU KNOW, UM, LIKE MATT MAREZ, WHO'S THE PROGRAM DELIVERY DIRECTOR, HE'S HA HE'S RUNNING INITIATIVES AT T AND UM, UM, THE AS AS WELL AS THE TASK FORCE, THE RTCB TASK FORCE, THE GMS DIRECTOR, BADRI, JUST WEKAS PREVIOUS ROLE, AS WELL AS THE PROJECT TECH LEAD, UH, SATYA CHRISTIAN.

WE ARE ENGAGING IN THE TECHNOLOGY WORKING GROUP, ENGAGING WITH THE MARKET PARTICIPANTS AS WELL AS THE VENDORS SO THAT, YOU KNOW, THEY DON'T LOSE COMMUNICATION AS WE, YOU KNOW, GO THROUGH LAYERS, RIGHT? SO WE WANT THEM TO DIRECTLY TALK TO US SO THAT WE CAN EXPLAIN WHAT THE CHANGES ARE AND, AND, AND, AND THAT'S THIS NEW BOX THAT WE ADDED HERE, RIGHT? THAT, THAT THIS IS WORK THAT WE ARE DOING, ENGAGING IT SO THAT

[00:35:01]

IT DOESN'T LOOK LIKE, YOU KNOW, 9 24 WHEN WE ARE DONE, WE JUST ISSUE THE REQUIREMENTS BACK AND, AND THEY START WORKING ON IT, RIGHT? SO ALL THIS FEEDBACK THAT WE'RE COLLECTING WITH THE MARKET PARTICIPANTS AND THEIR VENDORS HELP US LOCK DOWN THOSE REQUIREMENTS.

WELL, AND ONE THING THAT WE HAVE DONE IS STARTED A SURVEY SO THAT WE KNOW THE MARKET PARTICIPANTS AS WELL AS WHO THEIR VENDORS ARE, SO THAT WE KNOW THAT WE HAVE SPOKEN TO THOSE VENDORS WELL IN ADVANCE BEFORE WE RELEASE IT.

SO BIT OF WORK THERE THAT IS EXTERNAL FOCUS.

UM, BUT I WANT TO POINT THAT OUT AS WELL.

JP, ALONG THOSE LINES, DO YOU HAVE A ROUGH ORDER MAGNITUDE OF HOW MUCH LIKE THE TYPICAL GENERATOR WOULD HAVE TO INVEST TO ADOPT RTC? YOU KNOW, DO YOU HAVE ANY SORT OF SCOPE OF WHAT'S HAPPENING IN THE REST OF THE, I DON'T WANT TO GUESS HERE, BUT LET ME GET THAT APPROXIMATE NUMBER AND COME BACK.

IS THAT PART OF YOUR SURVEY? WELL, WITHOUT GIVING THE REQUIREMENTS, IT'S KIND OF A HARD QUESTION TO ASK.

OKAY.

RIGHT.

BUT WE CAN KIND OF SAY, THIS IS THE NATURE OF THE WORK, RIGHT? YES.

WHAT IS THAT COST? WE CAN PROBABLY DO THAT.

AND A LIKE RANGE, I ASSUME IT'S NOT, NOT GONNA BE OPTIONAL FOR THE MARKET PARTICIPANTS, RIGHT? BUT SOMEBODY'S GOT A BARREL THAT COST ULTIMATELY.

YEAH, AND IT'S A GOOD POINT.

WE'LL ADD THAT TO A SURVEY AND WE'LL GET THAT INFORMATION.

OKAY.

SO I PRESENTED THIS SLIDE WITHOUT THE LAST COLUMN IN DECEMBER, AND I INTEND TO DO THIS ALSO EVERY TIME THAT, UH, GIVE YOU A PREVIEW OF SOME OF THE SIGNIFICANT DATES THAT ARE IN OUR SCHEDULE.

UM, SO AT THIS POINT WE MET EVERYTHING.

UM, SO NO DELAYS, RIGHT? WE, WE MET ALL THESE DATES AND ALONG THE SAME LINES, AND THIS IS MY LAST SLIDE, UM, THIS HAS SOME OF THE SIGNIFICANT THINGS THAT ARE UPCOMING.

UM, AND THERE IS A FEB 16 DATE.

SO I KNOW, I KNOW FOR A FACT THAT THIS IS, UH, COMPLETE.

UH, ONE THING THAT WE DID DO THIS JANUARY IS THAT, UH, WHEN WE HAD THE DATES, WE ENSURED THAT THESE DELIVERABLES FOR SOME OF OUR KEY INDIVIDUAL CON UM, CONTRIBUTORS AND MANAGERS, THAT THEY'RE PART OF THEIR PERSONAL GOALS, RIGHT? SO THAT, UM, UM, YOU KNOW, THEY'RE COMMITTED TO MEETING THESE DATES AS WELL.

IT'S NOT JUST A CORPORATE, UH, LEVEL THING, RIGHT? AND IT'S CERTAINLY HELPFUL WHEN YOU HAVE A PROJECT THAT HAS A DESIGNATION AS TOP PRIORITY, BECAUSE IT'S EASIER TO MAKE THAT CASE WITH THIS PROJECT THAN ANY OTHER PROJECT.

SO HENCE, YOU KNOW, IT IS MORE EASIER FOR US TO REQUEST THAT THIS BE ADDED TO THE PART OF THEIR, UM, YOU KNOW, PERFORMANCE.

SO THIS IS MY LAST SLIDE.

AS I SAID, UH, WE'LL HAVE MORE DETAILS AS WE GET MORE IDEA ABOUT THE VENDOR DROPS AND THINGS LIKE THAT.

AND THE, AND WE'LL SEE THE PROJECT STATE, UH, SHAPE, UH, TICKING SHAPE SHIP.

IF YOU DON'T HAVE ANY QUESTIONS, I WILL HAND OVER TO BETTY.

GREAT.

OKAY, GOOD.

BETTY,

[4.3 Security Update Discussion Betty Day]

I PRE ANNOUNCED YOU SOON.

EVERYONE KNOWS YOU'RE UP NEXT.

SORRY.

OH, SORRY.

I SHOULDN'T HAVE DONE THAT.

OKAY.

OKAY.

ALL RIGHT.

GOOD MORNING EVERYONE.

I'M HERE FOR A BRIEF UPDATE IN, UH, PUBLIC SESSION TO PROVIDE A SECURITY UPDATE ON SOME RECENT COLLABORATION OPPORTUNITY WE'VE HAD.

UM, THIS IS JUST A DISCUSSION INFORMATIONAL ITEM ONLY ON, UM, FEBRUARY 2ND.

WE HOSTED AN INFRAGARD MEETING HERE AT THE MET CENTER.

INFRAGARD IS A PARTNERSHIP BETWEEN THE FBI AND MEMBERS OF THE PRIVATE SECTOR WITH THE INTENTION OF PROTECTING US CRITICAL INFRASTRUCTURE.

THE MISSION IS TO HAN ENHANCE THE NATION'S COLLECTIVE ABILITY TO ADDRESS, MITIGATE, UH, THREATS TO CRITICAL INFRASTRUCTURE BY FOSTERING COLLABORATION, UM, EDUCATION AND INFORMATION SHARING.

THERE ARE INFRAGARD COORDINATORS IN EVERY FBI FIELD OFFICE.

INFRAGARD REGIONALLY DECLINED DURING COVID.

I, UM, IN TERMS OF PARTICIPATION.

SO WE WERE PARTICULARLY EXCITED TO HOST THIS OPPORTUNITY ON FEBRUARY SE, UH, SEVENTH.

WE HAD ABOUT 20 PARTICIPANTS, 20 PEOPLE THAT PARTICIPATED IN THE MEETING.

AND I WANTED TO SHARE THAT WITH YOU TODAY TO DEMONSTRATE OUR CONTINUED, UH, COMMITMENT TO, UH, PARTICIPATE IN THESE TYPES OF COLLABORATION OPPORTUNITIES.

[00:40:01]

UM, SO REALLY THAT'S THE, THE POINT OF THE SECURITY UPDATE HERE IN PUBLIC SESSION.

UM, AS WE'VE SAID MULTIPLE TIMES, CYBERSECURITY IS A TEAM SPORT, SO THESE COLLABORATION OPPORTUNITIES ARE REALLY CRITICAL IN TERMS OF THAT INFORMATION SHARING.

HAPPY TO TAKE ANY QUESTIONS.

CAN YOU JUST TELL US WHO THE PROFILE OF PEOPLE WHO ATTENDED THE INFRAGUARD SESSION WERE? IT'S PEOPLE THAT ARE INVOLVED IN CRITICAL INFRASTRUCTURE WITHIN OUR, OUR INDUSTRY.

AND SO, UH, PRIMARILY UTILITY PARTICIPANTS.

UM, I BELIEVE IS, I'M, I'M LOOKING AT DREW AND HE'S NODDING.

SO, UH, REGIONALLY THAT'S THE, THE BULK OF THE PARTICIPATION.

WE HOPE TO HAVE THAT INCREASE GOING FORWARD.

OKAY.

OKAY.

ANY MORE QUESTIONS FOR BETTY? HEARING NONE, IT'S BACK TO YOU, JP.

I THINK FOR FUTURE TOPICS, UH, THIS IS OUR STANDARD, UM, YOU KNOW, BOILER PLATE HERE.

UM, SEE IF THERE IS ANY CHANGES THAT, UM, YOU WANT TO RECOMMEND THIS, THIS IS REALLY A CHANCE FOR, FOR MEMBERS OF THE COMMITTEE TO ASK FOR THINGS THAT THEY WOULD LIKE TO SEE IN UPCOMING MEETINGS AND SUGGEST THINGS THAT BE ADDED TO EXISTING PROJECTS.

SO I, I ALREADY MADE MY SUGGESTION.

OKAY.

SO PASSED TO THE OTHER COMMITTEE MEMBERS.

LINDA, ANYTHING? I DON'T HAVE ANY, I DON'T HAVE ANY NEW TOPICS.

OKAY.

OKAY.

THANKS VERY MUCH.

AND I THINK WE ARE FINISHED WITH THE, UM, GENERAL SESSION.

WE'RE GONNA MOVE INTO EXECUTIVE

[Convene Executive Session]

SESSION.

LET'S TAKE A FIVE MINUTE BREAK, UH, AND WE WILL RECONVENE IN EXECUTIVE SESSION AT 10 20.

GENERAL SESSION IS NOW ADJOURNED.

WE ARE NOT COMING BACK.

WE DON'T HAVE ANY VOTING ITEMS IN EXECUTIVE SESSION, SO WE'RE NOT COMING, WE'RE NOT .