CEO and founder of Decision Layer, Solomon Kahn chats with Rommil Santiago about why he thinks that most companies should not be A/B testing and shares what we should instead. He also discusses his recent debate with Ron Kohavi on LinkedIn on this same topic. Solomon's LinkedIn: https://www.linkedin.com/in/solomonkahn Solomon's email: solomon.kahn@gmail.com Original YouTube Video: https://www.youtube.com/watch?v=vqPylhO3ePU Original LinkedIn Post: https://www.linkedin.com/posts/solomonkahn_the-case-against-ab-testing-yes-i-know-activity-7184577272685719552-hFAB Ron's reply: https://www.linkedin.com/posts/ronnyk_abtesting-experimentguide-abtestingissues-activity-7185060367054565376-cAU9

It's that time of year again! It's time for Experiment Nation's 2024 CRO Salary Report. In this episode, we explore some of the report's highlights with Tracy Laranjo as well as ask her for her thoughts on how CROs and Experimenters can get paid fairly. Find the CRO Salary report here: https://experimentnation.com/experiment-nations-2024-cro-salary-report/ Tracy's LinkedIn: https://www.linkedin.com/in/tracylaranjo/ Tracys email: hello@tracylaranjo.com

Zach Lebovics shares insights on experimentation and product management. He discusses the importance of documenting assumptions, testing the best-case scenario first, and understanding that experiment failure isn't solely tied to the outcome. Zach also shares personal experiences and learnings from working in companies like Zynga, Ritual, and Tonal, providing valuable tips for product managers. Episode links Zach's Etsy shop link: www.mindfulmix.co Zach's Team Hub on Coda link: https://coda.io/@zach-lebovics/tonals-product-team-hub Chapters 00:00 Unlocking the Power of Experimentation: Insights and Strategies 00:23 Meet Zach: A Journey from Product Manager to Experimentation 01:56 The Art of Optimization: From Personal Life to Professional Projects 05:33 Diving Deep into Experimentation: Lessons from Zynga to Tonal 12:21 The Three Pillars of Successful Experimentation 30:26 Wrapping Up: Key Takeaways and Future Directions

Shiva Manjanath, discusses with Ana Kerkovic the significance of collaboration with stakeholders and stakeholder management, optimizing CRO processes, transitioning from testing to experimentation, the impact of copy testing, and the need for research-backed strategies in CRO. Chapters ----- 00:00 Unlocking Business Growth with Data00:24 Introducing Experiment Nation and Guest Shiva Manjunath00:45 Diving Deep into the World of CRO and Experimentation02:52 The Optimizer's Breakfast: A Routine for Success04:12 Anna Kerkovic Shares Her Journey and Passion for Psychology in CRO05:34 The Art of Persuasion: Manipulation or Motivation?06:29 Strategizing Beyond Spaghetti Testing: A Structured Approach to Experimentation14:15 Building Trust and Navigating Frustration in the CRO Process23:41 From Testing Ideas to Strategic Experimentation: The Journey of Learning31:06 The Importance of Copy Testing and the Future of CRO35:44 Wrapping Up: An Optimistic Outlook on CRO

Media.Monk's Juliana Jackson shares the truth about app development, optimization, and how web and app should work together.

Fractional Head of CRO, Tracy Laranjo talks about the power of Mentorship for Conversion Rate Optimizers (CROs). We cover: Why would CROs need mentorship? How do you find one? When are you ready to be a mentor and how do you get that word out? Would Tracy be a mentor for our listeners? GrowthMentor: https://app.growthmentor.com/mentees/sign_up?ref=970f4f6f79 Contact Tracy: LinkedIn: https://www.linkedin.com/in/tracylaranjo/ Email: hello@tracylaranjo.com Chapters: 00:00 Introduction 02:34 Tracy's Journey to Self-Employment 06:01 The Value of CRO Mentorship 09:45 Finding the Right Mentor 13:09 The Mentor-Mentee Relationship 18:14 Transitioning from Mentee to Mentor 23:06 Tracy's Offer to Mentor

🔥 Check out this insightful interview with Bryce York, Director of Product Management at Tatari, on Experiment Nation’s Conference! Here are 5 key takeaways from the interview: The similarities and differences between CRO and product management. The importance of overlapping skills and work in both areas, especially in smaller companies. Bryce’s background and journey from entrepreneurship to product management. The significance of qualitative and quantitative data in experiment design and analysis. The value of documentation and knowledge sharing in building an experiment-driven culture. Watch the video to gain valuable insights into CRO, product management, and experimentation! Chapters 00:00 - Introduction and Background 12:30 - Product Management vs. CRO 18:45 - Quantitative and Qualitative Data 25:20 - Minimum Viable Experiment vs. Minimum Viable Product 31:34 - Prioritization and Risk Assessment 34:38 - Getting Smart vs. Getting Lucky 38:54 - Experiment Log and Knowledge Sharing #CRO #ProductManagement #Experimentation #MarketingSkills #DataDrivenMindset

Documentation. The unsung, yet incredibly important part of any experimentation program. Great documentation allows you to look back at past experiments and find patterns of what were the most effective levers to inform your testing roadmap and levers you probably can deprioritize. In today's episode of Experiment Nation, our own Charlotte April Bomford recently spoke to Edmund Beggs about the "Levers Framework" which allows Convert.com to deliver results for their clients in shorter amounts of time. If you'd like to learn more about this interesting framework, watch the full interview.

🚀 Exciting Insights from Simon Girardin about learning from failure!🚀 📊 Takeaways from the conversation with Simon Girardin, CRO Program Manager at Conversion Advocates: 1️⃣ Speak Stakeholder Language: Report results in terms of uplifts, decreases, and revenue. Ensure clarity for stakeholders who may not be as versed in the technical aspects. 2️⃣ Learning from Tests: Emphasize the importance of learning from every test. Capture value by reviewing data, segmenting results, and analyzing user behavior through session recordings and heatmaps. 3️⃣ Strategic Iteration: When faced with a winning result in a specific segment, be cautious about immediate implementation. Consider the long-term impact on the user experience and potential tech debt. Iteration should be intentional and aligned with overall business goals. 🔗 Follow Simon Gerarden on LinkedIn for more insightful content on strategic testing and experimentation. 🌐 Connect with Tracy Lano and Experiment Nation for more interviews and discussions with top conversion rate optimizers. Chapters 00:00 Introduction and Welcome 00:23 Understanding the Importance of Learning from Past Experiments 00:56 The Role of Stakeholders in Experimentation 01:29 The Importance of Testing Strategically 02:34 The Process of Iterative Testing 04:34 The Importance of Segmentation in Testing 05:39 Interpreting Test Data 06:58 The Value of Inconclusive or Losing Tests 07:49 The Challenge of Iterating on a Test 09:32 The Importance of Prioritizing Hypotheses 11:40 The Process of Reviewing Test Results 15:00 The Role of Metrics in Testing 18:02 The Challenge of Implementing Test Wins 25:51 Conclusion and Final Thoughts #ConversionOptimization #Experimentation #CRO #MarketingInsights

Koalatative's Gerda Vogt-Thomas asks Rommil Santiago questions about how he started Experiment Nation and how he manages it while working a full-time job at Optimizely.

Data-backed web design refers to the approach of utilizing empirical evidence and user insights to inform the design and optimization of websites. By analyzing data such as user behavior, click-through rates, conversion rates, and heatmaps, designers can make informed decisions about layout, navigation, content placement, and visual elements. A data-backed approach helps identify user preferences, pain points, and areas for improvement, resulting in enhanced user experiences. A/B testing, user surveys, and analytics tools are commonly employed to gather data and validate design choices. By leveraging data, web designers can create user-centric interfaces that drive engagement, conversions, and overall business success.

In this insightful video, Ishan Goel, transitioning from a software engineer to a researcher, delves into crucial CRO statistical concepts. He sheds light on statistical significance in experimentation, explores A/B testing intricacies, emphasizes the efficiency of sequential testing, and discusses challenges in stopping tests prematurely. The talk concludes by highlighting the intersection of experimentation and statistics in the realm of Conversion Rate Optimization.

In this episode, Mike Green discusses the use of diary studies in UX research, particularly in the context of public sector user research. Mike Green, a freelance user research lead based in the UK, shares his experiences using Google Forms, structuring incentives, and addressing challenges in recruitment for diary studies. The discussion emphasizes the longitudinal nature of diary studies, contrasting them with traditional usability tests, and highlights their effectiveness in capturing user feedback over a period of time. Mike also touches upon the importance of understanding user behavior, attitudinal responses, and the ethical considerations in dealing with vulnerable groups. The planning and design stage for diary studies is emphasized, stressing the need to align the research goals with the chosen methodology. Overall, the video aims to provide insights and tips for conducting impactful UX research using diary studies in the public sector. Chapters 00:00 Introduction to Diary Studies with Mike Green 03:21 Understanding the Purpose of a Diary Study 06:45 Recruiting Participants for Your Diary Study 10:12 Analyzing Data from Diary Studies 14:30 Key Considerations for Diary Studies Success #UXResearch #DiaryStudies #UserExperience #ResearchablePodcast

Learn from André Morys, CEO of KonversionsKRAFT, on gaining crucial stakeholder buy-in for experiments. André highlights the challenges faced by optimizers and advocates for understanding team dynamics through stakeholder mapping. He emphasizes approaching stakeholders, using empathy to build relationships, and overcoming objections. André shares practical insights on conflict management, including a stakeholder map with color-coded power dynamics. Discover the significance of regular check-ins, fostering trust, and achieving tangible results in experimentation. Master the art of securing support for your experiments effectively. About growth marketing Summit: June 19th, 2024 in Frankfurt: www.growthmarketingSUMMIT.com - with 700-800 attendees it is Europe's #1 real-life conference with a handpicked lineup of great people you will usually not see at one conference. Andre's strategy illustrated: http://experimentnation.com/wp-content/uploads/2023/12/andre-stakeholder-strategy.png Chapters 00:00 - Introducing André Morys and the importance of stakeholder buy-in 04:12 - Understanding the stakeholder map and its color-coded quadrants 09:37 - The impact of stakeholders on experimentation in different company sizes 13:45 - Importance of building relationships and trust with stakeholders 18:20 - Recognizing objections and crafting strategies to address them 24:10 - Navigating implicit forces in larger organizations 24:43 - Learn about André Morys’ upcoming Growth Marketing Summit

Will Laurenson shares his journey from startup to becoming a CRO (Conversion Rate Optimization) expert. Will discusses the significance of usability, anxiety, and motivation in CRO, drawing from his extensive experience in running tests and optimizing various businesses. Will's approach to CRO involves deep insights into user behavior and a focus on aligning products with customer needs, challenging the common pitfalls of assuming product-market fit based solely on initial traction or advertising success. Chapters: 0:00 - Introduction to Will Laurenson’s CRO Journey 2:30 - Transitioning from startups to founding Customers Who Click 6:15 - Understanding the usability, anxiety, and motivation in CRO 10:45 - Onboarding process and working with clients at Customers Who Click 15:20 - The UAM Method: Usability, Anxiety, and Motivation in CRO Will's podcast: https://customerswhoclick.carrd.co/ Will on LinkedIn: https://www.linkedin.com/in/willlaurenson/

You need to invest in ad optimization. Effective performance marketing / advertising optimization relies on continuous experimentation, data-driven decision-making, audience insight, and refined targeting. It's not just about numbers; creativity, a deep understanding of advertising channels, and ethical targeting are crucial. Brand trust and performance marketing are interconnected, with customer reviews and testimonials playing a significant role. Embracing experimentation and learning from failures is essential for long-term success in performance marketing. Transparency with clients, a focus on the bigger picture, and purposeful action are keys to building trust. Joe discusses the launch of AD Scientists and encourages connecting with other industry professionals. If you want to follow Joe, check him out here: https://www.adscientist.ca/ https://www.linkedin.com/in/joefitzpatrick1/

Maximizing results in ad network optimization requires a systematic approach. Start with A/B testing on Google Ads and gradually introduce more complex campaigns, balancing technical and creative aspects. Analyze your channel's performance, ensuring sufficient impressions and conversions for statistically significant results. Shape your product to align with the ad network's requirements and consider user experience. Prioritize velocity in testing initially, gradually enhancing quality, and encourage collaboration across different platforms for valuable insights in the quest for optimization.

Lucas, a senior conversion specialist, shares his journey in the media industry, emphasizing the transformative impact of A/B testing. He discusses myths about experimentation - debunking them along the way as well as highlights the importance of validation, integration into essential projects, and showcasing negative results. Lucas encourages testing the obvious and unexpected, questioning assumptions, and showing the value of experimentation to reduce risk and aid decision-making, making it an asset for senior managers and specialists.

Personalization timing matters Eric Melchor, an evangelist at Optimonk, emphasizes the importance of focusing on the product page for effective conversion rate optimization (CRO). He suggests treating website visitors as individuals and creating a personalized and enjoyable customer experience in real-time. Melchor also discusses the significance of capturing visitor interest early on and leveraging smart CRO tactics and personalization timing throughout the customer journey. Additionally, he mentions the value of optimizing the product page, as it can yield significant returns on investment.

We explore various angles of CRO Organizational Structure. We discussed primarily the differences between centralized CRO teams vs a company-wide experimentation culture, and how this is best looked at as a continuum. Companies starting out might benefit from a centralized CRO team whereas more mature optimization programs can benefit more from working experimentation into all facets of the company. How can a company who does 0 experimentation introduce and adopt an experimentation process/culture? We also chatted about experimentation at the customer level, what this means, and how it could be the future of optimization.