This article was written by Leila Shaban, Research Associate at Metis Strategy
Thank you to everyone who attended and participated in the 17th Metis Strategy Digital Symposium. Highlights from the event are below. Check out Metis Strategy’s Youtube channel and Technovation podcast in the coming weeks for recordings of each conversation.
Companies continue to make progress in their AI journeys, deploying the technology to drive efficiency, productivity and innovation. Technology leaders are focused now on driving adoption, generating buy-in for new initiatives, and rolling out new training programs to ensure teams across the enterprise are able to take advantage of what AI has to offer. Below are a few highlights from the event:
Building a foundation for AI at scale
Nearly all CIOs on stage said scalable infrastructure and high-quality, accessible data are key to driving value from AI initiatives. Over the past few years, many organizations have focused on building data platforms, shifting to cloud and rethinking ways of working in order to deliver AI at scale. “Having a really good data infrastructure is foundational to taking advantage of any of these generative AI capabilities,” Priceline CTO Marty Brodbeck said. Many speakers noted their current efforts to get reliable data into the hands of more teams across their organizations.
Nearly half of MSDS attendees said that the rapid evolution of AI, among other macro issues, will have the biggest impact on their organizations in the year ahead
Exploring new use cases
Many organizations continue to train generative AI on internal knowledge bases to streamline processes and enable more self service. CIOs also see potential around developer productivity.
Bristol Myers Squibb receives thousands of calls from physicians and nurse practitioners each day requesting information about specific, often technical, topics, Chief Digital and Technology Officer Greg Meyers said. MDs on the other side of the call often find those answers in internal documents. Now, an AI chatbot trained on the company’s knowledge base can search through the documents to retrieve answers to these questions much faster. With enough fine tuning, Meyers noted the chatbot could constrain search results to trusted documents and help agents provide near-immediate answers to customer queries.
At UPS, Chief Digital and Technology Officer Bala Subramanian recently launched an internal AI tool for email which can process the tens of thousands of customer emails UPS receives on a daily basis, connect relevant information across internal policies and procedures, and generate responses for contact center employees. This ultimately improves worker productivity and reduces response time. UPS also launched an AI chatbot to help employees answer HR questions. Subramanian noted that the company is proceeding slowly due to the sensitive information and personal data in HR systems, and emphasized the critical role of risk management and governance.
At AstraZeneca, AI is significantly reducing the amount of time it takes to conduct research. Cindy Hoots, Chief Digital and Information Officer, described a generative AI-enabled research assistant that quickly searches both internal and external data to answer complex scientific questions. The assistant has helped reduce the time it takes to conduct a literature review from months to minutes, she said. Hoots is now focused on scaling AI adoption. About 15,000 employees use the research assistant, she said, while roughly 5,000 use Copilot solutions and almost 80,000 have access to AstraZeneca’s internal ChatGPT.
At KB Home, employees evaluate a number land deals across 35 markets every week. Aggregating property data from different sources to determine whether to make an acquisition used to take 30-90 days, CIO Greg Moore said. With AI, KB Home can now complete the process in less than two weeks. The faster turnaround now enables the company to make more evaluations and manage more potential deals in the pipeline.
Developer productivity is another area of rapid experimentation. Many of the tools offered by major vendors are in their early days and have room to grow, said Brodbeck of Priceline. The team is exploring solutions that can learn from Priceline’s codebase and provide a richer and more contextual experience. Whether for code generation or another use case, Brodbeck said companies will likely need to deploy retrieval-augmented generation (RAG) to deliver more productivity.
At Augment, CEO Scott Dietzen is thinking about how to retrieve knowledge from internal codebases in a way that protects intellectual property and reduces the risk of leaking sensitive information. The team started with basic engineering tasks that can make developers more productive rather than trying to replace them altogether. Demand for these kinds of tools will last for at least a decade as organizations produce more software, Dietzen said.
The top use cases for digital assistants/copilots that are driving the most value for MSDS attendees are code generation, self-service chatbots, and enterprise search/knowledge management
Bringing the organization along on the AI journey
To drive a common understanding and widespread adoption of AI, CIOs have increased their focus on storytelling and talent development.
At Wilson Sonsini, Chief Information Officer Michael Lucas is focused on cascading AI communications across the firm. His team started with a general awareness campaign. That included employee town halls to communicate the broader strategy as well as AI-centric briefings to partners. Given the sea of media coverage about AI, Lucas encouraged leaders to develop their own elevator pitch to help their organizations clearly understand the company’s AI strategy. Driving a common understanding across the firm is key to driving adoption. “We feel like we need to learn, understand, enrich, and then apply and operationalize,” Lucas said.
At Liberty Mutual, Global Chief Information Officer Monica Caldas is delivering customized employee training and connecting it to the company’s capacity demands across 27 countries. It’s part of a workforce strategy plan called “skills to fuel our future.” First, the company surveyed more than 5,000 employees to determine their skill level around topics like data, data engineering and software engineering. Next, the company mapped over 150 skills, connected them to 18 domains, and assessed how and where to invest in training.
Now, Caldas and her team are helping employees apply that training to a variety of career paths. Instead of a traditional career development ladder, Liberty Mutual is evaluating how to map skills to different jobs and create a “jungle gym” or “lattice of opportunities.” The focus on specific skills, Caldas said, “will help you position your capabilities as a tech organization not just for today, but also plan out where it’s going.”
Education at the executive level is also critical. To bring executives along on the journey, Caldas introduced a program called Executech that helps improve organizational data literacy and elevates the digital IQ of decision makers. Enhancing teams’ tech acumen gives leaders the confidence to start conversations early about important technology topics like API integration.
AI adoption may not be uniform, and there is still lots to learn about how it will impact specific roles. At Eli Lilly, employees who have incorporated AI tools into their workflow are reluctant to give them up, said Diogo Rau, Chief Information and Digital Officer. However, widespread adoption is a continuous and sometimes challenging process, “a lot harder than anyone would guess,” Rau said.
Rau often gets more questions about the risks of AI than how it can be used to improve products and services. Another challenge is that teams excited about creating AI bots aren’t always excited about maintaining or training them. “There are lots of good firefighters, but not every firefighter wants to be a fire inspector,” he said.
62% of technology executives who attended the Metis Strategy Digital Symposium anticipate that the most significant impact that AI will have on talent is increased productivity
Leveraging ecosystem partners
Achieving the transformative potential of generative AI will require collaborating with networks of vendors, startups, peers, and academics. In addition to providing technology solutions, these ecosystem partners can help upskill employees, explore emerging challenges, and prototype new use cases.
Amir Kazmi, Chief Information and Digital Officer at WestRock, draws learnings from both established technology partners and startups. He also brings in academics and peers from other companies to share wins and lessons learned about generative AI.
Regal Rexnord’s Tim Dickson, Chief Digital and Information Officer, uses hackathons and internal events with vendor partners to increase the company’s digital IQ. The company also offers self-paced training from about 10 partners that includes pathways to certification. In the past seven months, more than 100 employees have received training on GenAI fundamentals from Databricks and robotic process automation from UiPath, as well as certifications from Microsoft Copilot. Even if employees don’t use these tools every day, increasing the number of people with technical skills means more individuals “can at least help, or even lead, these initiatives across the organization,” Dickson said.
CommScope CIO Praveen Jonnala, like many other technology executives, is thinking about how to drive a cultural shift around AI. He spends about 80% of his time on organizational change management and culture. He is also leaning into existing partnerships to take advantage of new AI solutions and educate teams. For example, he took business teams to Microsoft for a full day to learn more about the technology and its ability to unlock new business opportunities.
Advancements in artificial intelligence have opened the door for innovative ways companies can deliver unique and personalized customer experiences. Join us virtually on May 21 for our next Metis Strategy Digital Symposium where global business and technology executives describe how AI has improved their organizations, how they are continuing to foster a customer-centric mentality, and what the future of technology and digital looks like in the Age of AI.
C-level technology leaders, register here reserve your spot and stay tuned for agenda updates. We look forward to seeing you!
(Click here for highlights from our most recent Digital Symposium, and stay tuned to our YouTube channel for videos of our panel discussions.)
12:00 – 12:15 p.m.
Welcome and Introductions
Welcome and introduction to the Metis Strategy team
Peter High, President, Metis Strategy
12:15 – 12:40 p.m.
Customer Experience in the Age of AI
Marty Brodbeck, Chief Technology Officer, Priceline
Bala Subramanian, Chief Digital & Technology Officer, UPS
Moderated by Steven Norton; Co-Head Executive Networks, Research, and Media; Metis Strategy
12:40 – 1:05 p.m.
Driving Digital Innovation Ahead of Disruption
Greg Moore, Chief Information Officer, KB Home
Michael Lucas, Chief Information Officer, Wilson Sonsini
Moderated by Chris Davis, Partner & West Coast Office Lead, Metis Strategy
1:05 – 1:30 p.m.
Shaping the Story: Future-Oriented Talent and Innovation
Monica Caldas, Global Chief Information Officer, Liberty Mutual
Amir Kazmi, Chief Information & Digital Officer, WestRock
Moderated by Alex Kraus, Partner & East Coast Office Lead, Metis Strategy
1:30 – 1:45 p.m.
Entrepreneur Spotlight: CEO of Augment
Scott Dietzen, CEO, Augment
Moderated by Peter High, President, Metis Strategy
1:45 – 2:15 p.m.
Emerging AI Opportunities in Pharmaceuticals and Healthcare
Diogo Rau, Chief Information & Digital Officer, Eli Lilly
Cindy Hoots, Chief Digital Officer & Chief Information Officer, AstraZeneca
Greg Meyers, Chief Digital & Technology Officer, Bristol Myers Squibb
2:15 – 2:40 p.m.
Blueprint for AI Organizational Readiness
Praveen Jonnala, Chief Information Officer, CommScope
Tim Dickson, Chief Digital & Information Officer, Regal Rexnord
Moderated by Michael Bertha, Partner & Central Office Lead, Metis Strategy
2:40 – 2:55 p.m.
Closing Remarks and Adjourn
Click here for highlights from our February Metis Strategy Digital Symposium, or watch the panels on our YouTube channel. We look forward to seeing you!
Thank you to everyone who attended and participated in the 16th Metis Strategy Digital Symposium. Highlights from the event are below. If you missed the event, check out Metis Strategy’s Youtube channel and Technovation podcast in the coming weeks for recordings of each conversation.
Our next event will take place May 21. More details and an agenda coming soon. CXOs, are you interested in attending? If so, kindly register here. We look forward to seeing you!
The COVID-19 pandemic, global supply chain challenges and the broad resurgence of artificial intelligence created a sense of urgency among many technology leaders to modernize and improve their organizations’ digital capabilities. Today, many companies are beginning to see the results of those investments and talking about the strategic ways technology can continue to enable innovation and resilience. Tech leaders recognize the importance of playing both offense and defense as they continue to navigate an uncertain business landscape, and the continued need to align talent and business strategies as they plan for future growth.
Investing in resilience
Some leaders outside IT may argue that there is never a good time to invest in IT. But given how quickly the competitive landscape is changing, organizations can’t afford to pause. For CIOs, a question is where – and when – to make those strategic investments.
“It’s much more beneficial to invest in a downturn than in an upcycle,” said Gates Corporation CIO Diego Silva. During a downturn, there is more capacity and willingness for people to drive change, put new skills into practice, and move projects forward. The greater acceptance for change gives companies the opportunity to drive productivity and resilience, and ultimately put them in a position of strength when the next upswing comes around.
Indeed, many organizations took advantage of time during the pandemic to invest in digital capabilities. When the world was in “shutdown mode,” Sunbelt Rentals Chief Digital & Technology Officer JP Saini invested in the organization’s omnichannel retail capabilities, talent development, new innovation models, and other initiatives to strengthen the resilience and adaptability of the enterprise. As Metis Strategy partner Chris Davis notes: “Businesses are cyclical, but progress and innovation don’t have to be.”
MSDS attendees shared that the biggest barriers to advancing and maintaining digital capabilities are legacy operating models and legacy infrastructure
Managing both offense and defense
True transformation means not just building innovative products and services but also ensuring that all the processes that support those innovations are running as they should. For CIOs, that means playing both offense and defense well.
At pharmaceutical firm GSK, innovation has long been a core competency. As leaders discussed transforming parts of the organization, there was growing recognition that the company had to balance playing offense and defense, playing to win rather than “playing not to lose.” Offense includes those digital and data capabilities at the core of a company’s strategy, while defense-oriented activities may focus on areas like responsible AI and cybersecurity. It becomes a virtuous cycle, GSK Chief Digital & Technology Officer Shobie Ramakrishnan said. “Defense in service of the offense becomes important.”
Tech modernization is another area where offense and defense must be balanced. As Grainger CTO Jonny LeRoy noted, organizations that have been early adopters have a duty to tend to the IT garden over time, “to keep the weeds out.” Putting that into practice, Grainger is focused on the mechanics of how it grows, using its understanding of processes like customer acquisition and inventory management to guide the continuous development of its systems and solutions. Meanwhile, Grainger keeps an eye on the horizon and experiments with new technology as it comes so it can be ready for what’s next.
Continuously improving
Responding to a fast-changing market requires organizations to deploy new capabilities quickly and pivot when necessary. That requires a mindset of continuous improvement and a constant search for opportunities to align people, process and technology toward a common outcome.
Consider a zero-day cybersecurity vulnerability, one that takes advantage of an unknown or unaddressed issue and needs to be fixed immediately. Jen Felch, Chief Digital Officer and CIO at Dell, said the best way to be prepared is “not only to take care of it early, but figure out how to get fast.” While some may view behavior or process change as antithetical to speed, the efforts to make those changes and continuously improve can be major levers to increase speed and efficiency.
Felch recognizes the desire for continuous improvement among teams as well, not only to build skills but also to see the results of their work. Rapid experimentation cycles have helped, she said: “let’s see what we can do in two weeks and build on that and see how it goes.” Giving appropriate context, bringing in knowledge from across the organization, and encouraging a test-and-learn mindset can also drive empowerment across teams. On the process side, constantly improving data quality, information retrieval methods and learning opportunities have also aided progress.
The top talent efforts that technology executives are focused on to advance AI are widespread education/upskilling and scaling AI-based productivity tools
Adopting new ways of working
Technology leaders are also adapting their talent strategies to better suit their strategic goals. Barry Perkins, COO at Zurich North America, noted that having a majority of technology employees in India limited productivity and agility. Noting “ABCD” – AI, Big Data, Cyber, and Development – as four critical digital capabilities, the company has begun to reassess its talent strategy, including which roles should be closer to headquarters. “We can’t have agility if we’re having conversations thousands of miles away with different time zones,” he said. “It’s much easier side by side.”
Effective talent management also requires leaders to inspire teams about the organization’s future vision and help team members see their place in the plan. As Brinks Inc. CIO Neelu Sethi said, transformation of any sort is less about technology and more about people. She is working to create a true “three-legged stool” of people, process and technology rather than letting a single element be the focus.She also reiterated the need for true collaboration. “You cannot whistle a symphony,” she said. “It takes an orchestra.”
At Travelers, preparing talent for large-scale change has involved a focus on four areas: Customer First; Empower and Act; Test and Learn; and Prioritize. Chief Technology and Operations Officer Mojgan Lefebvre also emphasized the need for effective communication to drive trust and accountability through transparency. “People want to play a role,” she said. “Bringing them along and giving them that capability is important.”
A majority of MSDS participants are either experimenting with Copilots or other generative AI tools to enhance software developer productivity or scaling the adoption of these tools
Advancing generative AI adoption
Naturally, artificial intelligence continues to be a priority in 2024. After a year of initial exploration and education, many organizations are ramping up AI experiments and seeing ways to expand AI across the enterprise. Underpinning all of this exploration is a focus on value delivery and safety.
GSK established an AI policy and set up an AI governance council five years ago when the organization decided to scale AI across the company. Now, Ramakrishnan is thinking about additional risks around adoption and procurement to ensure AI can scale. Similarly, Travelers many years ago set up an AI accelerator team to explore potential use cases and create a framework for responsible AI use. Now, they are prioritizing a handful of use cases and in the process of scaling them across the organization.
“Generative AI is top of mind for every executive to accelerate their workforce and accelerate the products of the business,” said Varun Mohan, CEO & Co-Founder of Codeium. In a poll, participants said the biggest benefit to AI and generative AI adoption is increased productivity (67%), followed by improved products and services (17%). When it comes to advancing AI, 40% of attendees said talent efforts are focused on scaling AI-based productivity tools.
Around two-thirds of respondents see increased productivity as the biggest benefit to AI/generative AI adoption
Many speakers said they are currently using AI for use cases such as developer productivity and internal process automation. A key outcome: speed. “The more we eliminate the drudgery from the process, the more we can start to deliver value,” said Jen Felch of Dell. At Travelers, Levebvre’s team is exploring how generative AI can be an assistant or collaborator, such as quickly searching through and summarizing documents or helping team members access needed information. The company is also exploring how AI can be used to improve job descriptions and recruiting processes. Lefebvre noted that while many of their use cases are internally focused, they want to be able to scale the technology and “make it good before turning it around with customers” as there is also a lot of external value to capture.
At Grainger, LeRoy’s teams are experimenting with generative AI in technology (coding assistants) as well as customer service. Through internal hackathons, the technology team developed tools that are boosting employee productivity and allowing them to do more with a constrained budget. As use of these tools continues to scale, financial management becomes an important factor, LeRoy said. “Some of that is selecting the right model with the right capability level that’s not overly expensive, and managing how much information you put into them.”
Our next event will take place May 21. If you are a CXO and interested in attending, please register here.
Thank you to everyone who attended and participated in the 13th Metis Strategy Digital Symposium. As 2023 approaches the halfway point, leaders convened to discuss the rapidly changing economic, technological and geopolitical landscape and its impact on strategy in the months ahead.
Highlights from the event are below. Stay tuned to the Metis Strategy Youtube channel and Technovation podcast in the coming weeks for recordings of individual panel discussions.
As tensions continue to escalate around the world, technology leaders must understand and prepare for new geopolitical dynamics. Jared Cohen, Co-Head of the Office of Applied Innovation and President of Global Affairs at Goldman Sachs, argued that the notion of hyperglobalization ended before the COVID pandemic and that the world now faces a reorientation of supply chains and capital flows.
Technology executives are playing close attention to changing value chains and alliances. “Technology is changing geopolitics, and geopolitics is changing technology,” said Cohen. One of the biggest areas where technology is currently influencing geopolitics is in the area of generative AI, which Cohen dubbed as the “most disruptive experiment in anarchy” since the internet. He warned about the risk of people deploying large language models for “bad use cases” to cause real problems in international systems. While there is significant discussion around which companies have superior large language models, he noted a desire for the conversation to focus more on the implications of generative AI for the world.
George Lee, another Co-Head of the Applied Innovation Office at Goldman Sachs, said generative AI is dominating discussions with boards and management teams around the world. While its rapid growth offers many fascinating possibilities, it has also disturbed the human desire for order and linearity. Lee noted how creators are being constantly surprised as the emerging technology develops. “Anyone who tells you they know where this is going, how fast it’s going, and what our destination is, is just wrong.”
While conversations around generative AI have taken the world by storm, technology leaders today play a key role in translating the hype into reality. That means not only vetting new use cases for the technology, but also educating their teams about the benefits and risks of generative AI and creating policies that encourage innovation while ensuring responsible use.
“It takes courage to take a step back and say, maybe let’s not fall into the hype, let’s go about this in a methodical way,” said Digi-Key Electronics CIO Ramesh Babu. Babu created a community of practice around AI that includes stakeholders from across the organization and a list of key terms with consistent definitions to keep everyone on the same page. He also created a network of influencers within the company that serve as “education ambassadors” for the organization.
Allen Smith, CIO at Baker Tilly, recommended leaders approach generative AI like they would any other technology. “There is a difference between home runs and singles. Singles in this case are your front. Go do something, show it, have a tangible example,” he said. “Now, it can be used to fuel the really good ideas.” He also expressed concerns about the security and privacy risks that generative AI poses, noting the dangers that may arise from inputting sensitive data into services like ChatGPT and the need to identify and mitigate potential bias.
As companies continue to navigate an increasingly complex and competitive landscape alongside shifting customer demands, innovation will be a key source of differentiation for industry leaders. Many organizations find that design thinking frameworks help to formulate the strategy and direction that will help ensure they can harness that innovation effectively.
Michael Newcity, Chief Innovation Officer at ArcBest and President of ArcBest Technologies, highlighted the importance of empathy and deep listening to uncover unsaid user needs. To advance design thinking, Newcity has sponsors responsible for thinking through ROI, teams, timing, and other tactical factors that will help gain executive sponsorship and drive innovation initiatives forward.
Rob Krugman, Chief Digital Officer at Broadridge Financial Solutions, discussed the importance of understanding the value proposition for their customers’ customers, then working backwards to deliver value for Broadridge clients. “If we can solve the needs of that end customer, our client’s customer, the likelihood of us being correct is more likely than not,” he said. Across the ecosystem, “we’re all generating value, and we have a much better understanding of how to actually present and tell that story around value.” His team also works with the VC community to stay on top of emerging technologies and asks hypothetical questions to try and understand their impact on Broadridge.
Krugman laid out two different types of innovation: sustainable innovation, led by the product organization, and disruptive innovation. The key to both: “iteration, iteration, iteration, all based on validation.”
No matter the scope of a change initiative, whether adopting an emerging technology or implementing agile ways of working, leaders must act as role models for change within their companies and drive cultural transformation from the top down.
Hyatt Hotel Corporation’s CIO Eben Hewitt, who is working to nurture a product mindset and drive enterprise-wide behavior change, said engagement starts with the CEO and executive board. “When you see a boss acting that way, then you act that way,” he said. “You have to model it.” Hyatt also uses a “people playbook” to easily guide teams to resources they need for specific use cases, and Hewitt has encouraged the development of high-level cultural principles that inform behaviors throughout the organization.
Ultimately, culture is the most important driver of any organizational change. While many are familiar with Peter Drucker’s quote,“culture eats strategy for breakfast,” Ascension Chief Digital Officer Rajan Mohan added that “culture eats transformation for lunch.” At Ascension, Mohan has helped lead a transformation that includes a digital product orientation, end-to-end accountability and a focus on Ascension’s mission to reach underserved communities. With that shift has come a new mindset, as well as metrics that are more closely tied to business outcomes. “We’re not just measuring for measurement’s sake,” he said. “It is to demonstrate and deliver continuous value.”
Kathy Kay, CIO at Principal Financial Group, said driving cultural change requires leaders first and foremost to be their authentic selves. That includes a willingness to be vulnerable. “If you can’t show vulnerability…I think it sets a tone for people feeling less open,” she said. In addition to bringing that openness to her role, she works with peers at Principal to ensure leaders are giving teams necessary support, removing blockers, and helping them understand how their contributions matter. Kay also discussed the importance of adapting communications to local norms, particularly when working with teams across the globe.
Building a high-performance culture is of course linked to finding and developing the best talent. World Fuel Services CIO Josh McLean said some of the best people typically look for three things in their work: aspirational goals that give a sense of purpose; challenging work that helps them learn and grow; and being surrounded by other highly talented people. “I try to make sure those things are all present and in harmony, or a work in progress to get there.”
