Earlier this week, Telly, a startup known for providing free 4K TVs in exchange for increased advertising, unveiled a new voice AI assistant called Hey Telly at the CES trade show. Built with OpenAI’s large language model, Hey Telly functions as a chatbot, assisting viewers in operating the TV and engaging in conversations. The chatbot can also offer personalized recommendations based on individual preferences. Telly is also exploring the use of generative AI platforms like Midjourney and DALL-E to allow users to create AI-generated images for TV screensavers.
Telly utilizes various AI models, including OpenAI’s large language models, for different tasks. For instance, the startup employs a separate voice engine that translates speech to text and utilizes the raw text data for different AI models, depending on the intended use.
We have incorporated the models and processing that we find suitable for the specific use case, explained Sascha Prueter, Telly’s chief product officer.
Apart from startups like Telly, industry giants such as Samsung, LG, and Hisense are also integrating AI technology into their new TVs to enhance picture and sound quality. These companies are utilizing visual recognition to optimize the screen based on the content being viewed, as well as AI algorithms that analyze background noise and voices to optimize audio output.
TV manufacturers are also looking to expand the functionality of screens beyond entertainment. These new AI features aim to transform TVs into a central hub for various activities, including assisting with workouts, providing telehealth tools, and controlling other smart home devices. The ultimate goal is to replace other smart screens in the home and consolidate all functions into a single device.
Marketing professionals attending CES highlighted the potential of new transparent TVs from LG and Samsung, which are also powered by AI processors. These futuristic devices, which can function as traditional TVs or turn off to become transparent, offer unique opportunities for retailers to engage passersby by providing new ways to interact and shop.
AI technology is also enabling advancements in e-commerce. Telly has recently introduced AI-powered image recognition tools that showcase products directly on the TV screen based on the content being watched. During a demonstration at CES, viewers watching a basketball game were presented with options to purchase products worn by players. Advertisers can also sponsor product ads to be displayed alongside personalized recommendations.
Telly is not the only TV startup embracing AI and e-commerce. Another notable company, Displace, exhibited its wireless TV at CES this year. Displace incorporates AI technology to recognize hand gestures, allowing users to pause a show and analyze the screen for various products. Displace then suggests similar items for purchase. While Displace does not intend to run sponsored product ads, some of its TVs are equipped with an NFC reader, enabling users to make convenient purchases on platforms like Amazon.
Privacy concerns arise due to the integration of AI in cameras and voice tools. Ensuring the security of personal data, conversations, and financial information processed by AI systems is essential. Telly addresses privacy by including a shutter in front of the camera, requiring user permission before taking photos. Sensors on their devices monitor the presence and number of people in the room. Displace’s cameras are designed to pop up and can be closed when not in use.
While Telly incorporates advertisements into its business model, Displace aims to provide interactive and transactional experiences without selling user data. Advertisers can pay for interactive ads, offering viewers a more engaging and seamless experience with the content.
We are creating a contextual thing for the TV set, said Balaji Krishnan, the founder and CEO of Displace.
As AI technology advances in TVs, it is essential to strike a balance between convenience, personalization, and data security. With the rapid integration of AI, TVs are evolving into multifunctional devices that offer enhanced content and commerce experiences. As the industry progresses, consumer expectations, privacy concerns, and innovative applications of AI will continue to shape the future of television.
