Episodes

  • Brian Gracely (@bgracely) and Brandon Whichard (@bwhichard, from @SoftwareDefTalk) talk about all the major news stories in Cloud and AI from May 2024

    SHOW: 827

    SHOW TRANSCRIPT: The Cloudcast #827 Transcript

    SHOW VIDEO: The Cloudcast YouTube Channel

    CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

    NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"

    SHOW NOTES:

    LINKS TO ALL ARTICLES FOR MAY 2024 CLOUD NEWS

    Segments Covered in the Show:

    Good Old Fashioned Cloud NewsThe AI Innovation Continues Trend 1 - Is anyone going to talk about Cloud anymore? Trend 2 - Is AI a real conversation with Enterprise yet, or does AI need to go through a consumer period first? Trend 3 - Every large acquisition was deemed a “terrible mistake” within a few months, according to the press - (e.g. Hashicorp, VMware)Trend 4 - Is April to June the new “trade show season”, or will it just be “always on” in the new AI world?

    FEEDBACK?

    Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
  • Let’s put today’s AI era into some historic context by looking at the similarities and parallels to the explosion of the 1st wave of the consumer Internet.

    SHOW: 826

    SHOW VIDEO: https://youtube.com/@TheCloudcastNET

    CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

    CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

    SHOW SPONSOR:

    Panoptica, Cisco’s Cloud Application Security solution

    SHOW NOTES:

    Building the Information Super Highway (pre-2000)Executives discuss the Information Super Highway2001 - A DotCom Bubble Odyssey (Cloudcast Eps.772)

    WE’RE FASCINATED BY THE IDEA OF TECHNOLOGY CHANGING EVERYTHING

    2000s era Internet was going to change everythingGenAI is predicted to change everything

    MOST TECHNOLOGY’S SHIFT HAPPEN WITH CONSUMERS FIRST

    GenAI still can’t validate accuracy (e.g. hallucinations)GenAI is still extremely expensive to create, maintainGenAI still doesn’t have a widely-adopted business modelShadow GenAI groups will emerge in the EnterprisePeople are still mostly thinking about GenAI as a way to offload things they don’t want to do vs. improving their existing skills

    FEEDBACK?

    Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
  • Missing episodes?

    Click here to refresh the feed.

  • Tim Crawford (@tcrawford, CIO Advisor at @AVOAcom) talks about the challenges of the modern CIO, managing stability vs. innovation, and understanding the business value of tech.

    SHOW: 825

    SHOW TRANSCRIPT: The Cloudcast #825 Transcript

    SHOW VIDEO: The Cloudcast YouTube Channel

    CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

    NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"

    SHOW SPONSOR:

    Neo4j explores knowledge graphs and vector search (graphstuff.fm podcast)See what graphs can do for you at Neo4j.com/developer


    SHOW NOTES:

    AVOA WebsiteTim’s article on HashiCorp

    Topic 1 - Tim, welcome back to the show! We’ve been friends for years, and it’s great to get you on today! We will discuss everything at the top of CIOs' minds today. Why don’t you give everyone a quick background on how you became known as the CIO Advisor?

    Topic 2 - Before we go into trends over the last few years. Put everyone in a CIO mindset. What do they care about? How do they think about the intersection of technology and business? What keeps them up at night?

    Topic 3 - We’ve heard many times CIOs have to balance two things: keeping the lights on (the boring side of the business that is often undifferentiated, and the innovative side that often moves the needle. A CIO’s job is to minimize the former and maximize the latter. Do you agree? How accurate is that statement?

    Topic 4 - I’ll follow that up with a real-world example many organizations might be facing, one we’ve discussed on the show in the past. We’ll discuss VMware on one end of the stable, the keep the lights on model, and AI on the other end as an innovative technology that could differentiate. Let’s talk about VMware first


    Topic 4b - Now the other end of the spectrum, AI. Have we reached peak AI washing and craziness? Is the trough of disillusionment coming? How should a CIO think about it?

    Topic 5 - Let’s talk about economics over the last few years. Zero-interest money has gone away for VCs and startups and we are seeing some big changes on the vendor side. How does this impact the people you talk to?

    Topic 6 - Last topic, you were there and talked about Hashicorp when they rang the bell last week and then were bought 24 hours later. What was that like as someone who was there?

    FEEDBACK?

    Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
  • When you see the headline “<ex-employee> says <company> AI strategy is in chaos”, what does it really mean? Is any company’s AI strategy NOT in chaos at this point?

    SHOW: 824

    SHOW VIDEO: https://youtube.com/@TheCloudcastNET

    CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

    CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

    SHOW NOTES:

    Ex-Google says Google's AI strategy is in chaos (Decoder)The Transformer Paper from Google (foundation of GenAI)NVIDIA coverage on Stratechery (Ben Thompson)DBRX LLM from DatabricksArtic LLM from SnowflakeOpenElm LLM from AppleOpenAI and Apple sign deal, Apple still wants a Google optionIBM and Red Hat bring Open Source to AI with InstructLab

    WE OVERESTIMATE IN 1YR, AND UNDERESTIMATE IN 10YRS

    “Most people overestimate what they can do in one year and underestimate what they can do in ten years.” - Bill Gates

    DOES ANYONE REALLY HAVE THEIR AI STRATEGY FIGURED OUT?

    NVIDIAGoogleOpenAIMicrosoft / Azure / GitHubAmazon / AWSMetaAppleIBM / Red HatOracleSnowflakeDatabricksVCsStartups

    FEEDBACK?

    Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
  • Jonas Rosland (@jonasrosland, Head of Open Source Community @CIQ) talks about using AI tools to accelerate building and communications in Open Source Software (OSS) communities. We also discuss the differences between Community Roles and Dev Rel.

    SHOW: 823

    SHOW TRANSCRIPT: The Cloudcast #823

    CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

    NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"

    SHOW SPONSOR:

    Neo4j explores knowledge graphs and vector search (graphstuff.fm podcast)See what graphs can do for you at Neo4j.com/developer

    SHOW NOTES:

    Jonas’ session abstract from All Things Open (ATO) 2023Session slides and description of the talkHit Save! - Video Game Preservation OrganizationCIQ Enterprise Linux Platform

    Topic 1 - Good Afternoon Jonas! Give everyone a quick background on your time building open-source communities and a bit about your foundation. We’ll dig into both areas today.

    Topic 2 - We caught up at All Things Open last fall. You gave a fascinating talk on using AI tools to accelerate the building of OSS communities. Give everyone the backstory on how that topic and presentation came to be.

    Topic 3 - This may be a dumb question, but DevRel is (still) all the rage. What is the difference between the approach to building OSS communities and the straight-up DevRel teams? How is success tracked in each? Are there solid metrics, or is it “fuzzy”?

    Topic 4 - Sadly, as far as I can tell, the session wasn’t recorded. But, for me, the big takeaway was how much dabbling you were doing with the tools and your good and bad experiences. I learned a lot from a practical aspect. But, the AI industry and tools are moving so fast. What’s in your toolbox today and why?

    Topic 5 - What are some of the gaps in the tools today? What’s missing?

    Topic 6 - Let’s talk about your side gig. You were part of the founding team and are exec director of a video game preservation society, Hit Save! How did that come to be? What does that entail?


    FEEDBACK?

    Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
  • After just three years, AWS is making another change at the top of the leadership org-chart. What lessons can we learn from leadership transitions and what might come next?

    SHOW: 822

    SHOW TRANSCRIPT: The Cloudcast #822

    SHOW VIDEO: https://youtube.com/@TheCloudcastNET

    CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

    CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

    SHOW NOTES:

    Andy Jassy makes AWS leadership announcement“There’s no AI without the cloud”, says AWS CEO (Decoder podcast)Six things to know about the new AWS CEO, Matt Garmin

    AWS HAS NEW LEADERSHIP. WHY NOW?

    Adam Selipsky is out, Matt Garmin is in. What does it mean?Why is AWS making the change now?

    WHAT LESSONS CAN WE LEARN FROM SELIPSKY’S 3 YEARS AS AWS CEO

    Probably don’t take the job immediately after someone is the Nick Saban of techDon’t be the complete opposite of the previous boss (wings guy vs. wine guy)

    [Andy on X] Lead Amazon, married and father of two kids, big sports/music/film fan, experienced buffalo wings eater. Go Kraken!

    [Adam on X] Husband & dad. Water skier/tennis player. Fan of Seahawks & Sounders. CEO at #AWS.

    [Andy Jassy] I’ve always had a lot of respect for Adam, and we met several times to discuss the possibility of coming back to lead AWS. In those conversations, we agreed that if he accepted the role, he’d likely do it for a few years, and that one of the things he’d focus on during that time was helping prepare the next generation of leadership.[Andy Jassy] Matt has an unusually strong set of skills and experiences for his new role. He’s very customer focused, a terrific product leader, inventive, a clever problem-solver, right a lot, has high standards and a meaningful bias for action. Realize when your job is to lead and inspire vs. producing the weekly reportThe post-ZIRP CEO of AWS2021 - $62B, , 2022 - $80B, 2023 - $90B, 2024 - $100+BLost key peopleBehind on GenAI vs. other clouds“Wartime CEO” vs. “Peacetime CEO”

    FEEDBACK?

    Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
  • Mark Collier (@sparkycollier, COO @openInfradev) talks about the advantages of open source AI and the intersection of OSS and AI transparency, safety, and potential regulations.

    SHOW: 821

    SHOW TRANSCRIPT: The Cloudcast #821

    CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

    NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"

    SPONSOR:

    See what graphs can do for you at Neo4j.com/developer

    SHOW NOTES:

    Mark’s Talk at ATOEU AI Act PassesHow Tech Giants Cut Corners Harvest DataThe EU Guide Act - A Guide for DevelopersOpenInfra Foundation

    Topic 1 - Our topic for today is AI Safety and Regulation. I saw our guest speak at All Things Open here in Raleigh late last year and he is also a Cloudcast alumnus having been on the show previously talking about OpenStack and the OpenInfra Foundation. We’d like to welcome Mark Collier (Chief Operating Officer @ OpenInfra Foundation) for this discussion. Mark, welcome to the show.

    Topic 2 - There’s a lot of news today about AI safety and regulation. The industry also seems to be caught up in an AI arms race of who has the bigger model, faster model, etc. OpenAI have become the early category leader but they might have started with good intentions, but, contrary to their name, they aren’t open
 at all. One message in your talk is how open-source software will prevent the coming of the “AI overlords”. Tell everyone a bit of what you mean by this. What is the problem we are facing and many may not even realize it.

    Topic 3 - I don’t want to call you old (I think we are about the same age), but you’ve seen some things. You’ve also been around OSS and foundations for a bit now. How can open source solve the problem?

    Topic 4 - We hear a lot about AI regulation, but this seems to be a moving target. What is both the current and future state of AI regulation? In my opinion, we haven’t seen a lot of successful regulations to date. We saw recently the EU pass an AI Act. Is this the first of many? The start of a trend?

    Topic 5 - Let’s talk about the “day job”. What’s new with OpenInfra Foundation these days?

    Topic 6 - OpenStack releases are still going strong and you’ve even run out of letters on OpenStack releases and have rolled around on the alphabet and are back to C. This is the 29th release of OpenStack. What’s the news for the Caracal release?

    FEEDBACK?

    Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
  • Happy Mothers Day! And let’s explore some new happenings at the intersection of open source and AI.

    SHOW: 820

    SHOW TRANSCRIPT: The Cloudcast #820

    SHOW VIDEO: https://youtube.com/@TheCloudcastNET

    CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

    CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

    SHOW NOTES:

    InstructLab Project (github homepage)LAB: Large-Scale Alignment for ChatBots (research paper)Granite LLMs (IBM research - Hugging Face)7b-base model7b-lab modelInstructLab: What is contributing to AI LLM models was easy? (Redmonk)

    HAPPY MOTHERS DAY TO ALL THE MOMS

    Call you mom, be good to your wife, and be a role model for the young girls in your life

    OPEN SOURCE MEETS AI

    The big AI question: 1 model, or many models?2023 was the year of model diversity, and the beginnings of “open” models (Llama 2, Mistral, etc.)Can we make it easier to contribute to an open model?Can we create communities around models?Can we reduce the costs of expensive parts of AI? How can businesses bring their knowledge to a model, without security concerns about their data? (options like RAG (retrieval augmented generation) exist)

    FEEDBACK?

    Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
  • Malte Ubl (@cramforce, CTO @Vercel) talks about Front-End web development and clouds, how AI impacts front-end infrastructure, and impacts to the business.

    SHOW: 819

    CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

    NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"

    SHOW NOTES:

    Vercel (homepage)Elevate your frontend with AIV0.dev

    Topic 1 - Our topic for today is front-end development and front-end clouds, and we’ll also explore AI-generated front ends. Our guest is Malte Ubl, CTO at Vercel. Malte, welcome to the show. Give everyone a quick background on your time at Vercel and Google Search.

    Topic 2 - Let’s start at the start. We hear all the time about front-end developers and back-end developers. What is your definition of a front-end and, more specifically, a front-end cloud?

    Topic 3 - What are the most common use cases you see today? What problem are you solving when you talk to organizations?

    Topic 4 - How much of a front-end is typically integrated with 3rd party services, and how much is build your own?

    Topic 5 - Where does AI fit into this from a developer's perspective? Are we to the point where we can develop a front-end from a prompt?

    Topic 6 - Let’s talk about the business side of this. Do companies typically have a “front-end problem”? If so, what does it look like, and how do they know?

    FEEDBACK?

    Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
  • What are the key characteristics and red flags with today’s leaders in the tech industry? How to identify the leadership skills, the team building skills, and the execution skills.

    SHOW: 818

    SHOW TRANSCRIPT: The Cloudcast #818

    SHOW VIDEO: https://youtube.com/@TheCloudcastNET

    CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

    CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

    SHOW NOTES:

    WHERE ARE THE LEADERS IN THEIR CAREERS?

    Are they a 1st time manager?Have they managed distributed teams? Managed multiple teams?Have they managed a P&L? Have they had significant success in the past? What was their role?

    LEADERSHIP SKILLS, TEAM BUILDING, EXECUTION AND RED FLAGS

    Are you joining an established “team” or group that’s worked together before?Is the leader repeating a previous success, in a similar or different domain?What motivates the leader? What is their view on competition?What are the leader’s best skills? Do they recognize this? Does the leader augment their skills with the team around them? Do they recognize this?Does your personality mesh with the team you’re joining, or are you expecting to be a change agent?

    FEEDBACK?

    Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
  • Aaron (@aarondelp) and Brian (@bgracely) talk about all the major news stories in Cloud and AI from April 2024

    SHOW: 817

    TRANSCRIPT: Cloudcast #817 - CNOTM - April 2024

    CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

    NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"

    SHOW NOTES:

    LINKS TO ALL ARTICLES FOR APRIL 2024 CLOUD NEWS

    Segments Covered in the Show:

    Good Old Fashioned Cloud NewsThe AI Innovation Continues - Speed RoundTrend 1 - 2024 is going to be a year of big announcementsTrend 2 - We’re starting to see some (early) reality set in with AITrend 3 - Lots of things are being lost between Broadcom/VMware and AI discussions

    FEEDBACK?

    Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
  • Every few years we have to be reminded that open source isn’t a business model. Let’s talk about the business dynamics that everyone seems to keep forgetting.

    SHOW: 816

    SHOW TRANSCRIPT: The Cloudcast #816

    SHOW VIDEO: https://youtube.com/@TheCloudcastNET

    CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

    CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

    SHOW NOTES:

    Adam Jacobs discusses open source and business (The Changelog)“figure out how to play nice with competition” (Twitter)The will never be another Red Hat - Economics of OSS (a16z)

    OPEN SOURCE IS A LICENSE, NOT A BUSINESS MODEL

    There are rules around software licenses (e.g. Apache, GPL, etc.)There are no rules about how people feel about software, creators or maintainers

    FREE, FREE TIERS, EXTENSIONS, CLONES

    Red Flags: Writes most of the code, took VC funding (multiple rounds)Green flags: Lots of diverse (companies) contributorsYellow flags: Foundation owns copyright“There’s the business side and there’s the hippie side of OSS”“I have endless ambitions”“I didn’t build a forever entity”“When is the rug pull going to happen?”If a company takes VC funding, is open source anything more than a marketing vehicle?“Docker figured it out and now they are doing like $100M”. Did they? When is OSS personal, and when is it a company?Will there never be another Red Hat, or just not another Linux?How much is too much when determining if a company should give things away for free?

    FEEDBACK?

    Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
  • John Yue (CEO & Co-Founder @ inference.ai) discusses AI workload sizing, matching GPUs to workloads, availability of GPUs vs. costs, and more.

    SHOW: 815

    CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

    NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"

    SHOW NOTES:

    Inference.ai (homepage)TechCrunch postSiliconAngle post on ChatGPU

    Topic 1 - Our topic for today is sizing and IaaS hosting for AI/ML. We’ve covered a lot of basics lately, today we’re going to dig deeper. There is a surprising amount of depth to AI sizing, and it isn’t just speeds and feeds of GPUs. We’d like to welcome John Yue (CEO & Co-Founder @ inference.ai) for this discussion. John, welcome to the show

    Topic 2 - Let’s start with sizing, I’ve talked to a lot of customers recently with my day job, and it is amazing how deep AI/ML sizing can go. First, you have to size for training/fine-tuning differently than you would for the inference stage. Second, some just think, pick the biggest GPUs you can afford and go. How should your customers approach this? (GPU’s, software dependencies, etc.)

    Topic 2a - Follow-up question what are the business side, what are the business parameters that need to be considered? (budget, cost efficiency, latency/response time, timeline, etc.)

    Topic 3 - The whole process can be overwhelming and as we mentioned, some organizations may not think of everything. You recently announced a chatbot to help with this exact process, ChatGPU. Tell everyone a bit about that and how it came to be.

    Topic 4 - This is almost like a match-making service, correct? Everyone wants an H100, but not everyone needs or can afford an H100.

    Topic 5 - How does GPU availability play into all of this? NVIDIA is sold out for something like 2 years at this point; how is that sustainable? Does everything need to run on a “Ferrari class” NVIDIA GPU?

    Topic 6 - What’s next in the IaaS for AI/ML space? What does a next-generation data center for AI/ML look like? Will the Industry move away from GPUs to reduce dependence on NVIDIA?

    FEEDBACK?

    Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
  • For some strange reason, “maintenance” has been in the news quite a bit lately. Is there ever a time when maintenance is enjoyable, or appreciated?

    SHOW: 814

    SHOW TRANSCRIPT: The Cloudcast #814

    SHOW VIDEO: https://youtube.com/@TheCloudcastNET

    CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

    CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

    SHOW NOTES:

    AWS increased the price of longer-running EKS clusters by 6xBroadcom changes VMware licensing from perpetual to subscriptionBroadcom offers security patches to perpetual license customersIncreasing the Kubernetes support window to 1 yearDiscovering the XZ backdoor (Oxide and Friends, podcast)

    IS MAINTENANCE EVER APPRECIATED OR ENJOYABLE?

    Spent the day surrounded by maintenance activities (oil, AC, power-wash)The costs of maintenance are real and opportunityMaintenance often goes unappreciated and unseenNaming: Release Notes, Technical Debt, Chaos Engineering

    TECHNICAL DEBT VS. MAINTENANCE

    Should we encourage a lack of maintenance vs. innovation as a priority?Should we encourage active maintenance with lower hard costs?Is there a way to put respect on maintenance? (e.g. OSS maintainers)Do we undervalue maintenance (e.g. Backup/Recovery, DisasterRecovery, etc.)?What maintenance best practices do you use? What are the good and bad of them?

    FEEDBACK?

    Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
  • Kalyan Veeramachaneni (@kveeramac, CEO/Founder @DataCebo) discusses the generation and value proposition of synthetic data for GenAI.

    SHOW: 813

    CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

    NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"

    SHOW NOTES:

    DataCebo (homepage)Synthetic Data Vault - SDVTechCrunch ArticleMIT News ArticleTopic 1 - Our topic for today is synthetic data. While the concept and need for synthetic data has been around for a long time, it isn’t a topic that typically comes to the forefront and something we haven’t talked about until today. Today is a bit of crossing the streams between developers and testing data and using GenAI to achieve this goal. For this, we’re joined by Kalyan, CEO and Co-Founder of DataCebo. Welcome to the show

    Topic 2 - First, for those not familiar, what is synthetic data? What is the use case and need? What problem is it solving today?

    Topic 2a - Hopefully, listeners out there are making the connection to the advantages of GenAI for synthetic data, but take us through your original concept at MIT and the history of Synthetic Data Vault (SDV).

    Topic 3 - We recently did a show on the security and privacy of training LLMs where we covered the need to mask PII for the training of models for compliance. I can also see bias issues coming into play or maybe training data that doesn’t exist in the real world (weather models example). What are some of the use cases that you’ve seen require synthetic data sets. Are there certain industries (healthcare, financials, etc.) that benefit?

    Topic 4 - You were designing this based on GenAI before GenAI was “cool”. How has the rise of LLMs impacted this space?

    Topic 5 - If I understand this correctly, organizations would put generative AI on a problem to describe a need for a data set, the model would then evaluate the available data and create a quality synthetic or “fake” dataset. How would the organization verify the quality of the dataset? How would they validate that a synthetic data set is as good as the original data?

    Topic 6 - Let’s talk about resources for a bit. When I think of GenAI and training, I think of large amounts of hardware and in particular GPU’s that might have limited availability. Is that true here? Also, is this on-prem or in the cloud, or both?

    FEEDBACK?

    Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
  • With the AI Era upon us, the challenge of trying to learn and make sense of the technologies, the business opportunities and the pitfalls is both exciting and equally terrifying.

    SHOW: 812

    SHOW TRANSCRIPT: The Cloudcast #812

    SHOW VIDEO: https://youtube.com/@TheCloudcastNET

    CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

    CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

    SHOW NOTES:

    WHEN WAS THE LAST TIME YOU REALLY LEARNED SOMETHING NEW IN TECH?

    Cloud was all new, but not completelyThe pace of cloud innovation seemed fast, but not in comparison to AIThe focus was around one cloud vs. a new source every week

    PICK A TOPIC, READ, BE CONFUSED, LOOK FOR CONFIRMATION, RINSE, REPEAT

    Where to start the learning process? Where to pick a source of learning?(Coursera, MIT online, blogs/videos/search, etc.)How to determine legitimacy of the sources? How far to learn before stopping to make sense? Trying to relate it to something you already know? How and when to ask questions?

    FEEDBACK?

    Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod



  • Brad Winett (President/Co-founder @TrackItCloud) talks about platforms for entertainment and media. Topics include use cases, partnering with AWS, and creation and consulting services. We even dig into AR and VR a bit at the end.

    SHOW: 811

    CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

    NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"

    SHOW NOTES:

    TrackIt (homepage)

    Topic 1 - Our topic for today is media and entertainment in the cloud. I don’t believe we have ever done a show specifically on this topic, and there are some considerations worth talking about. For today, we have Brad Winett, President and Co-founder at TrackIt. Brad, welcome to the show. Let’s jump right in. The media industry as a whole has undergone major change, just like many others. Most of us see it from the consumer end as a cord-cutter. What made you jump into this market and this industry specifically?

    Topic 2 - Platforms and content distribution in the early days of cloud was a differentiator. I think back to Netflix, they initially had a market advantage because they were able to scale better and to more devices than anyone and even open sourced a number of internally developed items and were the AWS poster child. Over time, these user experiences have become the norm. How should people out there think about media platforms? Are we past the days of build your own?

    Topic 3 - What about use cases? Media streaming is pretty broad. What does a normal customer look like? Is this big streaming services, smaller companies, etc?

    Topic 4 - How much of the tech stack is AWS products and how much of the stack is custom typically? Walk us through what a media streaming stack looks like. How is this different from a SaaS provider providing a turnkey service?

    Topic 5 - I know TrackIt is a big AWS partner. Give everyone an overview of the landscape of AWS Partnership these days. Do you provide mainly professional services and consulting?

    Topic 6 - Where does open-source software fit into this?

    Topic 7 - I feel the standard last question these days is how AI will potentially enhance or impact this is some way.

    FEEDBACK?

    Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
  • What will be the adoption patterns for AI within the Enterprise? Will it follow the early days of Cloud Computing, or will new and different patterns emerge?

    SHOW: 810

    SHOW TRANSCRIPT: Cloudcast #810

    SHOW VIDEO: https://youtube.com/@TheCloudcastNET

    CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

    CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

    SHOW NOTES:

    WHAT WERE THE PATTERNS FOR ENTERPRISE IT AND CLOUD?

    Shadow ITHigh-scalability or Short-term Projects (and experimentation)Migration via “Cloud First” initiativesDifficult stuff came last

    WHAT’S DIFFERENT ABOUT AI vs. CLOUD?

    CPU to CPU was easier to calculate vs. CPU + GPUHave we learned any lessons about how to value people's productivity?Does Enterprise AI need a Crawl, Walk, Run scenario? Do they need to be sequential and linked? Are Enterprise AI use-cases well defined? How long is the Enterprise willing to fail at experiments? What’s the Enterprise tolerance for GenAI “flaws” (e.g. hallucinations, lack of citations, etc.)Will GenAI rejuvenate Predictive AI projects in the Enterprise?

    FEEDBACK?

    Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
  • Aaron (@aarondelp) and Brian (@bgracely) discuss the biggest tech stories, announcements, and trends from March 2024.

    SHOW: 809
    SHOW TRANSCRIPT: https://bit.ly/cloudcast-809-transcript

    CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw
    NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"

    SHOW NOTES:

    LINKS TO ALL THE ARTICLES FOR MARCH 2024 CLOUD NEWS

    Segments Covered in the Show:

    Good Old Fashioned Cloud NewsThe AI Innovation Continues - Speed RoundTrend 1 - KubeCon EU 2024Trend 2 - Microsoft continues to branch out from OpenAI as a partnerTrend 3 - NVIDIA held a pretty massive GTC event

    FEEDBACK?

    Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
  • Let’s dig into the mindset behind the VMware price increases that have been happening since Broadcom acquired the company in 2023.

    SHOW: 808

    CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

    CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

    SHOW SPONSORS:

    Want to win a Tesla Cybertruck or $100,000? Enter the WS02 Choreo Code Challenge (before April 30th)WSO2 Choreo - Why build a platform? Just add developers instead

    SHOW NOTES:

    What VMware might look like under Broadcom (Eps.629, June 2022)What to do about VMware (Day Two Cloud, Feb 2024)VMware 10X Price Increase Leaves Companies Looking for AlternativesVMware pricing in the Broadcom Era

    BROADCOM IS FITTING VMWARE INTO THEIR BUSINESS MODEL

    At least with acquisitions, Broadcom has a well-defined set of business metrics they expect from their companiesBroadcom acts somewhere like private equity in terms of investment, innovation, revenue generation

    IT'S A BOLD STRATEGY BROADCOM, LET’S SEE IF IT PAYS OFF FOR THEM

    In essence, the bet is that there is no replacement for VMware in the EnterpriseThe timing is interesting with the shifting of budgets for AI projectsIt puts customers in a position to pay more for limited upside, but having to distinctly cut other areas of their technology budget (risk the business)Customers have some options, but again they risk the business (e.g. hold off on security patches)Once a company accepts the new pricing, what guarantees are there about no additional big increases in the future? How much will this impact the longer-term vendor-customer relationship?

    FEEDBACK?

    Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod