Let’s go and get started. Welcome to… This is the last meeting? Yeah, in September. Crazy. Big news this week, had a huge change push out to the app with the internal release of v1.3. This is a step function change in how the visuals and structure of the app play out with a new tab layout with the my data section and entirely new chart, which is a really beautiful and consistent clean interaction. As we all know that the charts have been under work for a long time and we finally launched that straight to the homepage. There’s a lot more going on behind the scenes. There’ll be a couple releases, I’m sure in between now and in the next big push, but the v1.3.8, I think is going out to members this weekend. Congrats everybody that worked on this. It really is beautiful and an elegant change and really happy to see the direction.
There’s also been progress on structured data, tags and such. Behind the scenes, the work is being done to be able to start bringing in structured data and use it effectively. On the social side, improvements on comments and notification strategy. A lot of stuff is building, which will again be making its way into the app in the coming weeks. Casey’s lined up for a really hilarious number of podcasts and speaking opportunities over the next few weeks. Casey, we appreciate you. She’s been just crushing it with these and it continues to ramp up. We’re all here hoping to be able to support in some way. We had a couple print features roll out this week, men’s journal, women’s running. Casey chatted with New Yorker, really quite awesome, given that the press is continuing to be quite favorable. I think we also had a feature mentioned in a New York Times article this week.
We’re also shifting the whole new level to two episodes per week. This is primarily because we’ve got just so much content that we can work into that channel, but moving to two episodes a week is going to be an experiment. We’ll see how the engagement is and how that affects our growth rate. It will include additional work, that’s why we got Tony coming in. IRB marketing copy, the IRB project is moving forward as everybody, I think, knows at this point that this is the primary way in which we will be pushing forward with a real time integration. Because it is human research, it’s something that is a parallel path or really it’s two birds, one stone in the sense that we want to activate our data set for metabolic science and for research purposes. That’s always been the plan.
Thanks Tom for pushing forward with that. I’m sure there’ll be an update later in the meeting. The head of product role is posted privately. We’re working on bringing in expert conversations and speaking with early possible candidates before we roll that out to… I’m not sure why the sentence is cut off, before we push that product role public. We’re going to just work on direct referrals first and then we’ll be going larger. If you know someone and would like to have them speak with us or if they would like to speak with us, please put us in touch. Sam’s been pushing some fundraising conversations for the A round, so starting to build inertia there. Really great talks with many well known and very aligned funds underway. We’ll keep everyone posted on that. Besides that, we continued bringing great influencers and future affiliates across the major social platforms.
Casey did a little mini episode with Drew. Dr. Gottfried recorded the whole new Level episode, and we released Mike [inaudible 00:04:35] episode this week, which was fantastic. Also, I think we Casey’s made it onto the back of Dr. Gottfried’s book, which is currently number one on Amazon for women’s health, which is pretty phenomenal. Notably, we won… I don’t think we knew this was going on, but we were nominated as the best nutrition tracker in the GQ Fitness Awards this year, which was awesome. It came out of nowhere. We started to work with another group, the Space Station agency on landing affiliates and such. Then I got to spend some time in a clean room for the first time since I was at SpaceX, which is great. I was checking out some hardware and seeing the direction of future technology, quite a blast.
Then a really awesome content piece that I wanted to highlight this. Our eggs, good or bad for metabolic health. I know [inaudible 00:05:20] going to update us on this. What I loved about this article is that it was both balanced but also opinionated in the sense that it gave people an outcome. It’s like, “You can’t eat eggs.” That is what the consensus is. There is evidence on both sides, here it is, but ultimately this is something that based on all the evidence, is not going to be a problem. I think that’s what people are looking for. They want those. They want to know what to do, and our content is continuing to be awesome. All right, next up I want to intro Aaron Hanson. Aaron has been part of the Levels community really since close to the very beginning and in a pretty major way, given that he has been instrumental in what I think is really the first community project that we had at Levels, which is the wearable challenge.
Justin Meers [inaudible 00:06:08] announced the wearable challenge as an idea and experiment on his Twitter at some point. We were as unaware of his ideas as I think the broader community was. It ended up becoming a really awesome experiment in weight loss and in group like, one-to-many and one-to-one experiments with new audiences. Aaron has been running those challenges through I think 10 cohorts so far, or maybe 10 is launching later this year. I just want to thank him for just the phenomenal effort that he’s put in to building this and sharing the lessons learned with us and for being such a strong supporter and for taking the time to hang out with us today. Aaron, love to hear a couple words.
Yeah, well it’s great to be here. Thank, Josh. Hey everybody. I participated in Justin [inaudible 00:07:04] challenge as a first participant. I went through it, I’m like, “This is awesome, I want to keep doing this.” That’s how I got roped into running the challenges. Yeah, we’re on 10 cohorts, going to be launching the 11th. We’re actively accepting registration for the 11th cohort this month. For those on the 28-day accountability challenges, they’re kind of crazy. People bet $700 and then for each day that they keep their levels below 120, they earn that money back. It’s like a economics component to the challenges.
I would say it feels like working on cheat mode a little bit because we get to ride off the success and all the hard work that the Levels team is doing. The number of times in our feedback that we’ve heard people say this is a game changer. Everyone just loves Levels. I’ll just say a huge thanks to Braden and Mercy and Mez and Mike in the early days for helping us execute on these challenges. Yeah, I think some of the things we’re still experimenting. We run these cohort. I think the thing that we’ve identified is that people like taking… You all have probably identified as well, is that people like doing things together. I think the cohort based model is interesting. We’ve been running a bunch of experiments and terms of structure and incentives. We’ve run many challenges leveraging your metabolic score. We’ve had exercise streak challenges to see who can exercise the most. Keep maintain exercise streaks or have the most consecutive days where they’ve stayed below the threshold. Then we’re experimenting with resources and some health coaching add-ons.
Some of the key takeaways from building the community so far is that everyone participates in the community differently. Not having a ton of community experience before, my expectation was that we could get everyone to want to be involved to the same degree. That’s just not the case. Some people want to just observe and they’re happy observing. Some people will participate. They’ll comment on things and then some people will actively contribute. Everyone has different degrees of involvement that they want to have in the community. Our role is to build community journeys for each of those cohorts. The size of the group matters, related to participation. Having a really small group, that’s really intimate versus having a large group. A few other things… Do I have five minutes? Josh, how am I doing a time? Will you just let me know if I’m…
Yeah, this is great. This is a project debrief in and of itself.
Yeah, right. It sounds good. We found that similar to how everyone participates differently. Some people really wanted to meet and see other people, so we wanted to have kickoff video chats where they could see who else is in the cohort. Some people respond really well to competition, trying to get the best metabolic score while others don’t want to be involved in that. I think it’s really hard to find the right balance of introducing competition in these challenges without ostracizing other people. One thing we found is that repeat users get fatigued by new user questions. Having people that have been in the cohorts multiple times, they don’t necessarily want to see the same questions that repeat users see… People that are new to CGMs will have a lot of introductory questions that people have done a ton and a bunch and are familiar, don’t necessarily need to see everybody’s question.
We’re doing some experimentation with separating out repeat users from new users. With regards to content, people are just so busy and there’s a lot of noise and people don’t read content on the internet. We’re really trying to figure out how to provide just in time information. A lot of this content that we are providing to participants revolves around pivotal moments, when they lose, if they exceed 120, we will then use it as an opportunity to provide them with drips of content. In terms of community like rituals, people need nudges. Asking questions like, “What are you finding difficult? What surprised you the most? Regularly having moments to check in. Tools matter as much as I don’t want to focus on the tools, I think finding the right tool… We need to find the right… WhatsApp versus Circle, the type of the medium of where community members are congregating has been hard to figure out. I think it’s important to try to help people not have too much noise. Yeah, that’s like some of the key takeaways so far. I had 370 participants, 84% average success rate. That means that the success rate here being that they’ve maintained the number of days throughout the challenge that they stayed below 120. Yeah, just great to work with you guys and we love Levels. Thanks everybody.
Thank you Aaron. What’s exciting is all these lessons learned, these iterations in the background, I think we’ll continue to be able to merge this with the social and community efforts that we are building and people like [inaudible 00:13:06] Canal are thinking a lot about. In terms of tools, the tool may end up just being the Levels product, but with this additional community that’s being built through wearable challenge. For those that don’t know that are on the team, we do have a number of memos and takeaways that we wrote up after the first few challenges. I think we continue to do those debriefs. It’s really interesting. You should dive in there and see what people learned. In the earliest days we had literally nothing. We had these Levels app and we were [inaudible 00:13:36] together stuff to make a challenge out of it.
That’s where Aaron really outperformed. I appreciate you working through that. I think things are much more refined now. Some of the data is quite interesting. We had one cohort where the average weight loss was 9.8 pounds and we had another cohort where the weight loss was highly proportional to starting bmi. People that needed to lose more weight ended up losing more weight. The early data is quite promising. It’s really encouraging to see the opportunities in the weight loss space especially, couldn’t have done it without you Aaron. Thanks for taking the time and thanks for putting together the takeaways. It’s really helpful.
Yeah, absolutely. Thank you.
All right, jumping forward. Just going to touch on company priorities. Membership model, more work is happening on this. I think JM’s going to have a brief update there. Guided Journey, as you all know, Scott is taking lead on laying out the experience improvements for the core program. Social experiments, we touched on here. Lots of other stuff that’s going on in the background. Table stakes design, we had a big update obviously to the app today. Making big moves across all of these and I expect will be… These are somewhat challenging to just straight up check off. If you want to see what’s actually happening behind the scenes, check out the project updates in the forum in threads. That’s the best place to see this progress towards these big objectives.
Quick culture slide. Sam appeared in Canada this week. I think he’s hanging out with, I don’t know, I believe they’re on a hike or something this morning. I think Ben, not pictured is Howe who I believe is also hanging out with them, which is really cool. This is always fun to see and I want to congratulate Zach and Abby on the newest addition to their family, healthy baby born this week. Zach is taking a little time away to spend time as a new dad. That’s awesome and congratulations. Lastly, before I forget Levels, helps you see how food affects your health. David?
Sweet. Yeah, James going to kick it off.
Membership transition. We have our first look at the two major new screens and the checkout flow. One, about membership. This text is a placeholder but it’ll look something like that. Then the second one is when you buy CGM from us, it’ll be immediately positioned as something that you can get once or in a recurring manner, which I think will be really interesting as a number of folks who go through the program now, might not know that you can do that. Under that umbrella, Mez is beginning work on submitting the app to the app stores, particularly on iOS, which should be a process. It’ll be great to get that started shortly. Then finally one last slide, we are moving forward on blood work and had a great meeting this week to review the protocol in a formal way, which basically there’re questions people will be asked before they can get this and the tests that will be included. Engineering will begin on that I believe next week, which is very exciting. This is happening. Phase two should hopefully hit your veins sometime in mid October. Thank you.
Next step we have John with a video update, I believe. I think we can hear Josh. Let’s see.
The main goal of this project is to introduce more structured data into our logs. We see this project as a primitive or a bridge that will enable us to potentially build other features like context aware suggestions to speed up the logging process, suggesting tags from the pictures, tag exploration or insights like comparing my glucose response to the response of other people and hopefully other interesting projects. It’s important to call out that deciding on what to do next with this data is not in the scope of the project. We want to build us strong foundation and make sure that some artifacts like the auto tagging system or the tagging UI on the mobile application just work fine. Then we can play around with all this data. This project will have two phases. Most of the work will take place on the back side with some help from Howe and Helen. We plan to finish phase one by the end of October and phase two by the end of November. Find more information at levels.link/tagging. That’s it.
Super excited about this one. It’s going to be huge. Thanks John for a good update. Next I believe we have another video update from Rowlo. Take it away.
All right. Additive score update. This week was all about making sure that the new score is ready to go out to users. That has to do with code changes. That has to do with infrastructure changes, but mostly it has to do with what that looks like in the app. I really want to thank everyone who tried this out this week and share their feedback and pointed out the things that did or didn’t work for them. That’s really illuminating. I really appreciate that type of feedback. Thank you everyone.
Another avenue that we made sure to address this week was to call it out. Whenever a user opens the app, they’ll be greeted with a model to let them know that this is changing. There’s not that moment of stress when you realize that you potentially have lower scores. If we let you know upfront that, “Hey, it’s because we’ve changed this.” I think that can reduce that moment of confusion, which is the entire goal of the project. Also, making sure that the user has plenty of opportunities to give their feedback. That’s another thing we changed. Right now they can forward emails and just let us know what they think. Yeah, that’s it for additive scoring. We’re wrapping this project up. I’ll keep an eye on it making sure that whenever we circle back on scoring, that we have good feedback to fall back on and we have these learnings ready to support us. All right. Thank you.
[inaudible 00:20:56] en route to Brazil right now, getting ready for his wedding. Good luck with that. A quick plug for him on his behalf for the engineering team. His last PR for this still need to review. If someone could approve that, we can get that out for testing to users and then we’ll kick it off with or hand it off to [inaudible 00:21:15]
We’ve got some really exciting stuff going on in our social experiments. We’ve been hearing a ton of feedback and talking to the users that are currently in the community of glucose feed. It seems like most people are split into two different ways in most of the feedback we’re getting. They really like the social accountability aspect. Basically, the data that they’re actually posting in their food logs, they really like, that’s being exposed to other people that they know are going to keep them accountable. That’s really positive. Then second, they really like the content that they’re actually seeing their recipes that people are using and some of the ingredients they’re using and they want to know more. What we’re working on now is a way for them to actually ask more right in the feed for them to comment on the posts directly.
Then correspondingly to actually be able to close the loop of social interaction by going a little bit further in the notification system to let you know if somebody is commenting on your own posts, so you can get back to them. We’re basically thinking maybe a really lightweight email notification that could tell you that. Then starting to think about what a more robust notification infrastructure might look like.
The other big thing is that now we have a whole lot more people in the community glucose feed and a whole lot more posts there. Now with so much more quantity, we’re trying to think about how to concentrate that and actually have the signal come out. We’re trying to think about how to incorporate some filtering into this, whether you’re just filtering for your own diet like keto or if you’re filtering for your own goal like athletic performance or weight loss. I think that’s what we’re thinking about next and the right balance in between keeping it interesting but also not having sections of the social feed that are empty or wastelands. Of course, you can check out levels.links/social for more information on this. It’s all for social.
Thanks [inaudible 00:23:16]. Perhaps we can transition over to nutritionist [inaudible 00:23:20]. Tom.
All right, nutritionist marketplace project is humming along, doing quite well. We’re on track. Gabriel built the initial UI this week and thanks to David as well for a lot of helpful feedback. Casey and Ben recorded an in-app overview video that’s going to describe to members what this new feature looks like and is built for. Then we also added two new nutritionists, which I actually think is quite important. They’re both fairly high profile. Steph Greunke is Whole30’s dietician and Brigid Titgemeier actually built out the functional nutrition practice at Cleveland Clinic and worked under Mark Hyman, pretty high profile, excited about that. Next week we’re going to be starting testing. We look to ship this to members within two weeks from today.
Sweet. Now Justin, I think it’s another video recording, since he’s out.
Okay, I’m currently with Ben and Sam at a cabin somewhere probably on our way there. Giving a little remote update. For the table stakes we did a lot of little details. The headers here at the top. Steph worked on getting all caps titles and removing the back button labels and working on consistent icons in general. I also worked on some of these compare cards to make them a little bit more similar to how the other zone cards look. They’re still not perfect but they’re better. The color system is done, card styling is done and bun styles is done as well by Allan this week. I’ll show on the next screen, home tab is now using a new chart and zone cards.
For my data, this is going to be the final update for a while because we’re shipping it to members in a state that should be good to allow us to work on the other projects. So much has happened. Okay, so the activity catalog has moved to my data. Refreshed all the UI on that. It’s a bit more consistent. It’s still not the brand new design that Allan desires but it’s closer. Stats tab was removed. Profile tab is now on its own tab with me and learn moved over a tab. In removing the stats tab, we realized that home needed to have a couple things done to it. You can see on the left home tab now has these zone cards on it. It has a new chart at the very top and has a bunch of just style tweaks in general that go along with table stakes design.
Oh yeah, the filter screen on the catalog is also using the new colors just because it looked off with the old green. Also, there’s new day cards on day review and the sleep card look and the sleep cards also on the home tab. What else? There’s so many little details, but that’s about it for what’s shipping to members. Hopefully they like it and we’ll wait to see what feedback is like.
It’s a huge release. Congrats Justin. Helen has been working on this as well… Sorry, I mean it’s Steph. Taking a step back, this was one of the first projects that Allan kicked off with information architecture. This is like the culmination of a lot of the major changes that we had envisioned. Rearchitecting the app towards that’s much more intuitive home places for the different major types of actions and food in your day’s data. This is one of the biggest changes that we’ve had in a while. Excited to see it get out there. There’s more to come as Justin alluded to. Great milestone for the company. Congrats everyone. I think Scott is next on Guided Journey.
All right, guided journey. Same stuff this week, so still early responsible and individual work, specifically talking to more customers, doing more data benchmarking and doing more concept formation. I don’t know if this is just my style, but I tend to work on stuff for a couple weeks until it gels and then we’re off to the races and making a lot of progress. Next slide. Quick reminder, clear eyes, full heart. We did a lot of clear eyes stuff last week. This week I want to transition to a little bit more full heart stuff. Next slide. Specifically talking about onboarding. I laughed really hard at this tweet when I ran across it in June. I was able to track it down, but I really like it because I think it resonates really, really well with how people interact with things on the internet.
We have been focusing, I think, a good bit on our product and a lot of the initial customer conversations have uncovered so much around onboarding. I got to spend the first couple sessions with Allan this week doing some design jams and figuring out, “Hey, how do we want to do this differently? How can we make this better for our members?” Next slide. First up on the research was just like benchmarking. Let’s look at some other health apps. How are they doing this? I think, part of working as an engineer and in product is developing some emotional attunement to my own. I have my own health journey as well. I was able to acquire all of these products and get them going and I catalog the experiences. My intent is to do a full tear down at some points.
I haven’t had time to do that, but I have all the sort of material available that we can look back on. Conclusion wise, what came out of this was two things. Next slide. This should be nothing new, but specifically focusing on first of all, deep personalization. A lot of member feedback, “Hey it seems like this is just suggestions that may make sense for a broader use case, but I’m not trusting that it’s actually for me. I don’t really know where to start.” The second way is just a two way conversation. Right now we’re gleaning a lot of data off of these passive devices. We have a CGM, you’ve got your Apple Watch, your Oura Ring, your WHOOP. Whatever, it’s all generating HealthKit type of data. You do actively tell us about your food logs, but trying to get the onboarding set up and establishing that this is going to be very much a two-way conversation.
Again, these concepts are going to weave in and out of the guided journey project, but specifically around onboarding, we’ve got this opportunity to set up a good basis for it being a two-way conversation. That’s what customers should come to expect for us. When I think about depersonalization and two-way conversation, I think of, next slide, this handsome man and if you wanted to pay a lot of money to get set up to be part of his client base, you can do that. It comes with a lot of cool things. My assumption is that he would be on call almost like a friend. You could just text him your food logs, “Hey, I spiked really high on this, can you give me some feedback?” I would like us to get into the emotional seating in our head around, “Hey, we want to provide maybe like 90% of this experience for maybe 10% of the cost.”
That would be a great situation if we could get to that. Again, back to onboarding. How will we think about how Peter would onboard us? I’ve sort of been playing around with monikers for this project. A T on tap is something. If you guys have better ideas, please let me know because I’m not super drilled into that one. Next slide. Right now we have like medical, a system where you go do an intake form a lot this. This is your onboarding experience. I’m not sure when I go to the dentist why they need to know about my grandmother’s arthritis, but it’s on the form. My theory is that some lawyer turned into a doctor and this was the form that they created and it just has of perpetuated from there. Most of the healthcare stuff seems to be, “Hey, let’s just digitize the same really bad experience.”
It is very important that we do not replicate this. This is not going to be the step change that we need for people to trust us in a way that feels like they can have quite an intimate trusting health journey with us. Next slide. I’m pulling out all the meme things. In future weeks this is not going to happen. If I paint a spectrum, I do not want us to be saying things like digital delivery of care or remote diagnostics. It’s absolutely not the place that we should be in. I think of this more as a Ken Jeong or a JJ Redick where they went to med school, but they would probably go eat poutine with you on Friday and have a couple drinks and if that’s what you want and that’s what makes you happy, that’s okay, that’s the orientation that we want to have. Next slide.
Okay, back to this. Just go to the next slide. Sorry, I forgot what these. Honestly I was going to say [inaudible 00:32:27]. Maybe we can just hit some concrete examples. We don’t have marks marks yet, but just this sort of talk in words. Couple concepts that Allan and I… We spent I think two hours on Zoom together and we ended it with no pixels on the screen, but I felt like we had really, really good conversation about what is the emotional disposition that we want our members to have as they’re going through onboarding. Things like weaving conversation. What does this mean? Most apps may onboard you and it’s 15 successive screens of you just inputting health information and data. What’s your name? What’s your weight? Talk to me about your family history. It’s just next, next, next. You’re just sort of a mouse coming into this system. Doesn’t feel super great.
There’s a lot of concepts that we want to introduce. We want to introduce ourself as a company. Why we’re here, why we care about things like glucose? Why we’re using CGMs. Even us spending time, not just seconds but minutes, talking about, “Okay, if we hit one or two screens where we’re asking for information, we should go to one or two screens where we’re giving information.” It feels like they’re telling us about themselves, we are telling them about us. It’s this back and forth. Then when I think about of education cross with input, we’ve got a lot of opportunity because we have their eyeballs during onboarding. When we ask them questions like, “Do you have any family history of metabolic dysfunction?” They might not know what that means and it’s a good time for us to call out, “Hey, metabolic dysfunction usually in the worst case could represent a Type 2 diabetes. It also leads to cardiovascular and cancer acceleration.
A lot of people might not know that and we have their eyeballs at that moment. Allan and I are spending a lot of time thinking about what key concepts can we introduce at the same time that we’re asking for input. I wanted to level set this week on these sorts of things because we are going to be spending I think an inordinate amount of time on them. When I think about a first date, I do not think about scrappy. I think that we should be scrappy about a lot of things, but I oftentimes ask myself, “What are we not going to be scrappy about?” I think onboarding is probably one of them. It’s a good time for us to set up the relationship well, get people engaged and just get us set off on our right foot so that they trust us and they feel like they’ve really been taken care of in their first leg of the journey.
Next slide. Next steps, I’ve been saying this for a couple weeks, but I promise you I’m really getting into the nitty in notion doing phasing and scoping. I hope to have that within the next couple days, certainly by the end of next week so that we can just get stamped and get started working on some of the work. That’s it for me.
Amazing. I think we’re moving on to design. I wanted to call out one other thing which I don’t believe is covered in slides. Gabriel, you can catch me if it is. The updating your profile pictures is also ready for customers. It’s going to be out in the latest build, which is fantastic. It is behind a feature flag, so it’s not going to be out right away, but we can enable that at any point. Perhaps we can chunk it so that it’s enabled next week, so we get two product update emails for that. Yeah, the whole app is changing. It’s getting more social. It tend to get more connected to the Peter Attia on TED and it’s going really well. Thanks Scott for that. I think we’ll pass it off to Allan.
Yeah, thanks David. Next slide. That’s a little summary. The focus areas this were basically comms, looking at freelancers, having a couple interviews, onboarding journey, components and visual design. I think though probably the high level summary for the week was there was a lot of visual design. Next slide. Why was there so much visual design? Part of the table stakes design experience is making sure that we have components. We did this information architecture work, things all have a new home, but we need to basically have these building blocks that we can use as we start to take on more complex projects. Fun things like buttons, what do buttons look like? These different types of buttons. Sounds very basic. We’re talking about the core parts of the product experience actually what people are touching every day.
Cards, consolidating our styles, making sure it’s consistent. I think maybe what we don’t see sometimes in doing these visual design projects is that when we have a bit more consistency and consolidate styles and representations, it’s going to be a lot easier to crank out new features in the future. We’re revising levels scoring coloring system again. This was something in the background. I was hesitant to even include it, but we’re going to show it so it doesn’t surprise everybody when it goes out. The reason for this was consolidating color treatments for test results and how scoring works. Basically, green is good, red is bad and we’re going to stick to that. Then, again more just design components on the bottom right there. Next slide. The important part about having these components is that we’re trying to consolidate the way we accomplish things. As I was looking through the experience, I was noticing some of these designs were sort of ad hoc and we were throwing them together and there’s a couple different ways to solve the same problem.
Having some of these components and actually this new model one, I’m really excited about, it’s a little bit more assertive version of an information push to a user. In this example we’re talking about no low glucose alerts. We already do some of that with cards and those are good and we actually see high Click-through rate on that. We want to, when it’s really urgent, push to users and really get it right in front of them when it’s important. Next slide.
A nice little tiny task was actually only two or three hours of the week was looking at personas with Mike, trying to find a way to just take some of this great research that they’ve done and translate it into something that we can use more regularly. I think really what helps here is just having a high level summary, a more basic understanding of how people work. There’s some deep research and notes inside notion, creating these little artifacts that we can drop into slides so we can get in a regular cadence of talking about our individual users. Next slide, Oh [inaudible 00:38:49] Focus for next week is looking at more time spent on process. I think this is a healthy thing to continue to do. We want to make sure that during the design work and the transition to eng and development that we have a healthy feedback loop so that what’s happening in design is represented in the work and also design understands the constraints that engineering are working with. Going to be focusing a lot on onboarding and guided journey as well next week. That’s it for design.
I think that is it for all I had for product and eng. Who was going to cover the deploy velocity?
Oh me. Okay, cool. Deploy velocity, this came out of the Phoenix project book club. One of the things that we wanted to get a handle on was how quickly pieces of work moved through the system. I think the most crude way to do that is just track the number of deploys and it’s very… Oh man, I always script the alignment on the slides. It’s very important, I think the point being, so mobiles got different stuff than web. We’re going to have to account for that. The idea… you can go to the next slide. The idea with tracking deploys is just to make sure a couple things, like we just want to get a sense for how’s our velocity doing and if it’s going up or down, maybe we should know why, just we don’t want to go months with it being down.
How do we accomplish this? Okay, first of all, I think we got to measure it, of course, What you don’t measure. You’re not going to be able to tune or make better, especially with development stuff. Smaller changes are better. We’ve gone through this phase change as an industry of going from large waterfall and QA cycles into much more developer tested small batches with easy rollbacks. Keeping a handle on how big the change set is. Compressing review times, being able to track, “Hey, from the first commit to the pull request getting up to it, being merged into master to it deploying, what are those times?” These are also good leading indicators. Most importantly we need to track it per developer because as our edge complexity n squared goes up as the development team goes up. We need to make sure that we continue to have probably a linear step change in adding deploys every time we add a developer. That’s going to be gold standard if we can keep that up and running.
I was tasked with coming up with a tool or something to track this. Luckily for me, one of my former status page folks, the dev manager actually left to start his own company called Sleuth to do this exact thing. Fantastic. Sign up for an account. You can go to the next slide. All right, here’s Sleuth. It is basically the levels for tracking your deploys. This is great. We get stuff like lead time. How long is it taking from code getting into production. The frequency of deploys. It also does batch size. If you notice down at the bottom it’s splitting out, “Hey, how big are the change sets that are coming in?” This is just good for us to keep an eye on just to make sure that we are not like [inaudible 00:42:01] call out for needing a PR help.
That’s the sort of thing that these languishing can destroy your dev team morale. What sleuth does is it just tracks all the numbers. It gives you a nice pretty interface. I’m going to be reporting on this probably once every month or every quarter just to make sure that we’re in the loop. All of our stuff is wired up. In the future dates, if we want to, we can actually even wire this stuff up to Datadog and ping them so that we can automate deploys and rollbacks so things can go out and if our systems are detecting that things are not great, it can trigger a build pipeline to just put the old code back on production. Not quite there yet, but it does have that option and it’s a good way for us to keep change sizes super, super, super, super small and just right when they get into the main line of the code branch, they can go out to production. Ideally we will have that fluid of emotion at some point soon. That’s it for this.
Awesome. Great updates on all the projects and product generally. Thanks everybody. Quick hiring update, no major updates. We’ve got this support specialists and software engineer roles remaining open and as I mentioned, the head of product role is open but private. It’s not on our workable careers page just yet as we take direct referrals first. All right, over to Chris.
Quick update on member experience. The theme of the week is member love. We got a lot of it this week in two fronts. One, the 99 for [inaudible 00:43:40] for support, which is an all time high, which is incredible. Only one person said the support was okay, everyone else thought it was great. I know we talk a lot about our great support, but this is actually a new high water mark. I’m super proud of the team and right behind it, a new high for NPS at a plus 83, which is just incredible. I realized it’s only for a week, still a sample size of maybe 90, so there’s enough in there. A good question came up as David asked around, had we had the Mark Hyman podcast around a little bit more mass market, would that draw our score down? When I filtered on that cohort, it was actually a plus 90 with 158 responses, which is super strong.
A lot of signals around as we tap into some of these groups in terms of what they think about it and also around a lot more we can do, which is really why on the first thing around, I’ve been spending a lot of time thinking about text analytics tools. Not just looking at the score, but what’s in it, what’s changing as we segment it, as we break it up, like how things change and as we tap into different audiences and different segments and different cohorts. Then lastly on support, we’re doing an analysis around how we leverage workflows within help scouts. Are we efficient? Are we using quick snippets, more opportunities for efficiency to service more customers faster? That way we can scale with less people. Tons of great… As you’ve mentioned, the support specialist, super excited about the talent coming in for a support role.
Lots of really great experience, which basically talks to me about people are just banging on the door around how can they be part of the Levels journey in any role they can get and [inaudible 00:45:24] willing to do anything to be part of the movement. Super exciting and that’s it from member experience.
That’s a mind blowing slide. Thank you Chris and team. Crazy. Ben.
Hey team, this is growth for the week. $85,000 of recognized revenue past our goal of 75. These numbers are being reported at roughly 1:00 PM Pacific Standard Time on Thursday, September 23rd, so a day earlier, little bit earlier than we normally report them. 445 have recognized revenue for the month and 82 in the bank, our cash position hasn’t changed. No changes to debt and 42 months of runway. Growth theme of the week. Great, Scott. If anybody’s familiar with one of the greatest movies of all time, Back to the Future, this is the great Doc Brown. What’s the point of this? Well, we’re starting to get a lot of founders, a lot of companies, even different people in our cap table reaching out and they’re asking about our process for experimentation. They’re wondering how do we come up with experiments and how do we do them so quickly?
It’s got to the point where people have asked us to create content and even to be involved in things like virtual summits. The takeaway is that as a team, all this experimentation that we’re doing applies across projects, the responsible individual ones, it applies across some of the growth initiatives that we’re undertaking, whether they’re partnership related or working with people like creators. Then even some of the minor product feature updates that we’re doing. Everything is essentially an experiment and different people are looking at Levels and they’re saying, “Hey, cool. It’s very neat to see the way that the team comes together and executes these things fast.” Embrace our inner Doc Brown and don’t forget the flux capacitor along the way. That is growth for the week. As far as [inaudible 00:47:29] Levels wise, Sam is coming in today, he’s here in about an hour.
Justin, Sam, Howe is on his cross Canada road trip and the four of us are going to end up meeting up and that’s very cool. On the personal front, it’s tied into Sam being here. Penny is excited, all the kids are very excited that Sam is coming in and Penny keeps talking about how excited she is that Tom is coming in. I keep cracking her saying that Sam is coming in and she said, “Yeah, I know Sam’s coming in, but I can’t wait till Tom gets here.” She has a very special place in her heart for Tom. She has expressed it on many video bombs that she’s done in some of her one-to-ones we’ve had. Anyways, Tom, Penny is very excited you’re coming here sometime soon. That is growth for the week.
Tom. You’re letting people down.
This is growth.
Why does it always restart? There we go. All right. Over to you Tom.
That warms my heart. Ben set me a video of Penny this morning asking multiple times about when I was coming. Okay, so a few highlights and themes this week. First we’ve gotten more traction with CrossFit over the last couple of weeks, getting connected with a lot of top athletes, so wanted to briefly take a step back and remind the team how we’re thinking about making inroads into a community like CrossFit and more broadly like ProSport. TL;DR are strategies in notion, but it’s not really core to our partnerships and marketing strategy right now, but we are picking our shots selectively and putting time into building certain relationships. There are a couple of notes where we’re very much still testing demand in these communities. We approach all relationships at Levels, whether it’s partnerships or investors. Authentic alignment is our number one priority.
For now, we’re still focused on just product seeding and finding our evangelists within certain communities and better understanding if and how we can add value to them. We’re also focused on building relationships with individual athletes. We often get connections to leagues or governing bodies and we sometimes take those calls, but our focus is very much is grassroots, build relationships with the athletes. Then lastly, just noting that it’s always important to know why you’re going after some of these markets and communities. I think with pro sports there’s either brand value and/or revenue potential. If you were to partner with say a high profile NBA player, that would be about brand value. I think with the CrossFit community, we’re still evaluating it as a possible market with meaning full revenue potential. More to come on that, just wanted to provide an update there.
Then I’ll gloss over influencers, lots of new ones this week. I know we’re tight on time. Then in terms of new experiments, as Shah’s mentioned, been chatting with an agency called Space Station. The way these agencies work is you don’t pay them upfront, they just connect you with people and then they make their money off of percentage of whatever you spend with the content creator. TBD, weather, it makes sense for us to work with agencies. There are a few reasons why it’s interesting. It really speeds up our ability to just product seed to as many aligned creators as possible and then again, figure out who’s going to be an evangelist for our mission and product. Then also learning, these people are working with brands like Oura and Magic Spoon. We’re doing hundreds of deals and experiments, you can get up to speed really quickly on what’s working and what’s not and just take best practices from a lot of these agencies, even though I know Sam hates the word best practices and then just run a lot of experiments as we prepare for growth mode. I’ll leave it at that for now.
Awesome, thank you. Press
Sweet. I know we’re running tight on time so I’ll move through this quickly, but it has been a crazy month for press. I just wanted to do a monthly overview because we haven’t talked about it in several weeks. First I want to shout out JTPR because they’re doing a really great job and their relationships with the industry have just led to a lot of really easy placements for us and interviews. Also, to Stacy because her photos that she’s taken are basically all over these incredible outlets and we just should never forget that this art that Stacy’s creating is just such a amazing gift. To have that type of quality on our team, it’s unbelievable. We had a great feature and real simple. It was article about Bao and Broth, they reached out about it and we basically just made all our quotes about metabolic health and micronutrients and all these things that seed our core bigger picture message in education. That was awesome.
We were in Financial Times and Josh had some incredible quotes in there that were really exciting, beautiful piece with some original illustration art here. Then we were in Health Magazine. I think this might be my first magazine picture here with me with the patch on. We were in a really esteemed group of other devices with Oura and Lumen. That was awesome. Next slide.
We made it into women’s running and men’s journal, both with beautiful features with images, our rendered pictures of our app here, as well as Mike DiDonato being a total badass running across these posts in New York. That was really cool. Next slide. We also just last week were listed as GQs best nutrition tracker in their 2021 Fitness Awards, which is so, so cool. Then we had a New York Times feature by Kara Swisher called the Quantified Selfie. Next slide. Just digging a little bit more into the New York Times article. Kara Swisher has a longstanding aversion to wearables. She’s coined the term unwearables and still gave us several positive signals in this article, which was pretty exciting. She basically slammed other wearables, Oura Ring, WHOOP, and others says that they’re growing dust in her drawer. Then followed that up by saying an important feature of CGM is that they offer data that may be useful.
She basically feels like the data streams that she’s getting from a lot of her wearables may not actually impact her life positively. Then goes on to talk about how it did. Another cool distinction that she drew was that it gave her data about how she felt. She noticed an inevitable energy crash whenever she ate bread in the morning, even though as she craved it. She talked about our funding round. She used the term metabolic health, gave a good portrayal of what our mission is and the importance of accessibility, the goal to a wide range of people, more data to graph about glucose level reactions to the food we eat, when we eat them and in what combination. With the CGM device, you can see how your body reacts to specific foods. In my case, the device knew that Pitta Bread was evil incarnate for me shooting my glucose numbers off the charts.
Really went into detail about her data and finished the piece by saying, “It’s an interesting investing space to watch as more money pours in. No matter what, put down the donut.” I would say, given that she is a big critic of wearables and often not excited about the hot new thing in Health Tech, I was thrilled with some of the signals that she gave us here. Congrats team. Yeah, that’s it for press this month. Oh, actually one other thing. We have also have just a bunch of really cool things in the pipeline. Josh mentioned a couple of these, we also just had our hour-long interview with the New Yorker. We’ve had interviews this month with Women’s Wear Daily, Fast Company and Reuters. More stuff in the pipeline.
Huge. Yeah, hard to overstate the positive signals in that care switcher piece. Thank you Casey. Content [inaudible 00:55:42]
Yeah. Real quick on this. Three good pieces up this week, all pretty long, but worth your time. I’ll say the Dr. Sara Gottfried is an example of taking a podcast, editing it down into Q&A, but with this one we really couldn’t edit it down very much because there’s so much in there. I think it holds the record for longest estimated read on the blog at 34 minutes. We’ve chunked it up into section. I think this is going to be a really good piece that people will come back to again and again to check out different sections of it and just want to call it on the far right there, continuing to feed the medium site, which is really going to become the hub for how we do things at levels and why we’re unique as a company. If the blog is about metabolic health, this is really about remaking work.
For Casey’s suggestion, which I think was a great one. We put up the internal notion doc we had before about how we do meetings. I think this is really nicely organized. I think this can be really popular. Just keep in mind that these pages are out there when people ask you about how we do stuff, part of the reason we’re putting things out a medium is to give people a site to go to and easily find this stuff and be able to share links to them. The last thing I’ll mention at the bottom there is we sent out a unique email test yesterday. We’re trying the idea per Sam of what if we just let our user base know our list, know when we have one cool article out. We sent out eggs as a one off yesterday just to see what happened. I haven’t looked at the stats yet, but we’ll update next week how that did. The huge document that Casey assembled about advice about how to interpret blood tests is going to be turned into an article that will go up on the site shortly as well. Again, I think this is going to be hugely popular. That’s it for me.
Awesome. Yeah, 100%. I love the reuse of the content across channels. It’s going to be great to keep building on that. All right. We’re at time. If anyone has to jump, totally understand. We had a lot to pack in this week, but we’ve got the Levels cafe segment afterwards, which we will use for individual contributions if that’s okay with everybody. To kick that off, Mercy.
Professionally, there’s just so much in this meeting that got me really excited about and just awesome, literally everything. Then personally, I’m going to be off for a week. I’m going to see all my family. Josh is going to get married next week. I will be at the shore with everyone. That’s super exciting. Also, I’m finally getting a new phone. I’m going to go to Apple today and get the latest iPhone. Yeah, I’m excited.
Yes, I am excited about… It’s my birthday today and I’m 34, and I love birthdays. Thank you. I’m staying at a husband wife married couple friends. I’m staying at their house today. I got woken up by their three and two-year old daughters jumping on my bed with balloons and it was the sweetest way to start the day. Tomorrow I’m making a quick 24-hour trip to Boise, Idaho before LA to see my 99-year old grandmother. I’m very excited about that. Then Code Conference and Max [inaudible 00:59:03] podcast recording in LA next week. Very excited to hopefully meet Sam Harris down there at the Code Conference.
That’s amazing. Big week. [inaudible 00:59:16]
Levels wise? Yeah, I’ll just echo the app is just looking phenomenal. I love all the design changes and the new features. On a personal front, we just booked a spring break trip, so always out to London and Paris, redoing a trip we were supposed to last year that got canceled for COVID. Excited and hopeful that that will happen.
Yeah, huge week. The thing that’s had me excited all week is really the app release. It feels like a massive step change, one that we’ve been waiting for a while and just really proud to use the app and show it off to people. Good work everyone on that end. Then on the personal side, I had an awesome afternoon with Steph on Tuesday, so great to meet in person. Some awesome conversation and grateful and thankful to have put people like her on the team and happy to be working together. Nice to meet you Steph. That’s it for me.
That’s fun, Allan.
Yeah, I echo that. It’s really nice to see the information architecture project come to its conclusion. I wrote a little post on threads saying goodbye to the hamburger menu. It’s been a very useful little hack, but we’re going to get rid of it and I’m excited to [inaudible 01:00:27] I do. On personal side, I’ve been doing these long bike ride slightly on the weekend and so excited to try to do that again and keep up the streak of weekend rides.
RIP, hamburger menu. Mike D.
Mike D (01:00:49):
Yeah, definitely be remiss if I didn’t mention the recent update. I personally saw [inaudible 01:00:59] use out of it and I can only imagine what it would be for members. Then just to see the projects moving so quickly. Velocity is a value of ours, so it’s pretty cool. Then finally, it’s been cool to work closely with Chris. He’s been showing me some stuff. He’s been doing a lot of alum, so Chris, appreciate you. I think I request alum all the time and that’s it.
I’ll just say it’s so cool to get a peak behind the curtains and see the passion and thoughtfulness that y’all have. I’m thankful for that. Yeah, really fun. Personally, it’s been oppressively hot here in Austin. It’s finally starting to cool down, I’m thankful for that.
Very nice. Yeah, season change [inaudible 01:01:49]. More appreciated in some areas of the country than others.
Let’s see, is Kunal? I think Kunal had to jump. Stacy.
Think Stacy had another meeting start too.
Well she’s listening [inaudible 01:02:03]
Speaker 17 (01:02:06):
Yeah, just to echo what everyone else said, I’m super excited about the new app look. It looks so cool, especially since I’m coming in right before and now I get to see almost immediately after it looks like it happened so fast. Then on a personal note, I’m just happy I’m on the mend finally.
Nice. Feel better, Keep feeling better. Yeah, for me, let’s see. Professionally the app progress is phenomenal and just the fundraising conversations are exciting and the pilot conversations with additional devices and international thing, there’s just a lot of even behind the scenes inertia that’s building and it feels really exciting. Right now am struggling for words because I’m just pretty dead tired. I took a late flight last night, had a couple 1% recoveries on WHOOP while I was traveling out to LA. It was not a great self-care couple days, but a very, very exciting professional couple days. That’s good. We are now officially in my wedding week. D-day is arriving soon. It’s going to be fun. I get to hang out with my family. Friends coming in. It’s going to be a great week. As it relates to work, assume that I’m going to be approaching off the grid status here in the next few days. If I owe you something, please hold me accountable to get that to you. All right, Gabriel, not on the call. Who we got next? Scott.
I’m actually really excited about social and nutritionist stuff. I’m just talking to a lot of people that are texting me now, “Well, what’s your diet? Can you help me help me get access to it?” I love the concept of people being able to do some self discovery and just see what the Levels Team is doing, quite honestly. That’s good. On the personal side, we keep stealing a couple of summer days and so I’m actually going to go kayaking with a friend today and be out there for a couple hours and hopefully bring some beers.
Nice. Enjoy that. Chris,
On the levels front, I’m just honored as I meet candidates around as they apply for the support specialist. People that regularly say comments like, “Levels is the only company I would consider leaving my current job for.” It’s not just like, “Hey, I’m unemployed, I need a job, it sounds cool.” Like this is the only thing that would take me away from being fully employed at a job that takes great care of me. That just is humbling and reminds me of how lucky I feel to be a part of this company. On the personal standpoint, if you remember from last week’s exciting episode of Hobby Farm Life, Chris got a new chainsaw and was out playing with it and almost took my foot off. In this week’s episode, I’m doubling down the fun and pulling out a new log splitter. Let’s see how that goes? Do I lose another limb or not? Stay tuned.
Log splitters, they’re a fun tool, but there’s nothing like swinging an ax, chris. If you really want to lose [inaudible 01:05:17]
I got one of those. I’m going to take that out as well just to make sure [inaudible 01:05:19]
All right. Chris, I hope you keep all your limbs. I’m coffee shopping, so apologies for background noise. Levels wise, these updates on Friday are always just so thrilling. The app looks awesome. I have to get a shout out to A and Casey for content, especially this week with the egg piece. I was able to send out to my mom, which is awesome because she’s been on my back about eating five, six eggs for breakfast. That was great. Personally, I had a great time in Denver this past week and really excited to be back and it’s awesome weather in Houston. I’m going to buy some sunscreen [inaudible 01:05:57] outside.
Love it. Steph. No, sorry, Tom.
Plus one to everything that everyone has said, but I’m going to go with giving a shout out to synchronous communication this week because I had three. I know Josh, his eyebrows are up. I had three coffees, lunches in New York that were Levels related this weekend. They were all just really enjoyable and I feel like we made some extra magic happen that we wouldn’t have over email or Zoom. That was great and then personally a lot, but I’m going to go with the fact that I started watching succession. I’ve never watched TV ever and my friends think that I’m an alien because I can never participate in any conversations and so I finally decided to start watching a show and it’s been a really awesome, much needed break for my mind every so often to put on an episode. So
Awesome. Professionally, I’m really excited about the design stuff. Shout out to Allan for all the hard work he’s been doing with just all the really, really nitty-gritty designs. Something I’m particularly excited about with that is moving towards a design system and a lot of the work on the app itself, like there’s such minuscule changes and so I don’t even notice them, but knowing that now we’re using a lot more reusable components and utilities, then velocity in the future will also be quicker when we’re building new features and easy to stay consistent with that. Personally, yeah, it was awesome to meet up with Mez in the city and thank you for showing me around. He put up a compelling case for why San Francisco was so amazing. That was fun and then, yeah, I’m actually leaving the Bay Area and heading down to Southern California for the foresee of the future. I’m so excited about that.
Very nice. All right, I did want to make one more mention, I’m super stoked that we didn’t… I don’t know if we’ve announced this yet, but Taylor Sittler will be joining us as well who co-founder of Color Genomics and MD and operator and a lot of really awesome capabilities that are coming to the team. It’s one of those examples, I remember this when Chris was talking about how his keynote conversations have been going. I think it’s one of those examples where Taylor was very happy doing what he was doing as a former founder and taking some time away. And this was the thing that I think had enough gravitational pull to force him to step up and say, “You know what? I got to be a part of this.” Anyway, Taylor, I know you’re going to watch this. Really excited to work together and big pick up for the team. With that right about on time here, everybody have a great weekend. I probably won’t speak with many of you before mid-October. With that I’m going to hand off the reins to Mez who’s going to be hosting this while I’m gone, unless you can rope somebody else in. Yeah, have a great couple of weeks.