Telehealth Creates New Opportunities for SIs

Over the past three years there’s been a profound change in the healthcare industry. Telehealth and virtual care are not just here to stay, they are the new normal. Not only do providers and patients benefit, but systems integrators (SIs) do so as well.

With healthcare organizations and hospitals seeing less of a strain on resources and more areas for revenue, they are looking to invest in the digital health space. And this equals new possibilities for SIs that turn to BlueStar, a global distributor supporting SIs, VARs, and MSPs for the right technology, solutions, services, and expertise.

“These solutions are definitely key to success…with a greater opportunity within the healthcare space,” says JoAnna Whitting, Healthcare Business Development Manager at BlueStar. “Telehealth is obviously not going to go away. I think it’s one of the things where it probably would have been implemented sooner. But you just may not have had the strength of some of the software partners that had their solution baked and ready to go.”

Solution Providers and SIs Tackle Healthcare Needs

Telehealth was the only immediate solution that could deal with the demand of COVID-19. Hospitals were at overcapacity and having to open temporary triage stations to treat everyone. On top of that, patients still had appointments, medications, and treatments they could not wait until the unforeseeable future to receive.

“Telehealth became the only stopgap measure that health systems quickly had to adopt as a technology because you simple couldn’t get in the door,” says Whitting.

So, as a reactive measure, healthcare organizations started to make use of consumer videoconference solutions like Google Meet and Zoom. Once the initial shock of COVID-19 wore off, the industry started to realize these solutions were not built or ideal for healthcare services. It started to look for more proactive approaches to addressing the new demands.

With almost every aspect of healthcare now impacted – communication systems, supply chain, standard care services – the industry turned to partners and SIs to tackle healthcare’s specific needs.

For instance, telehealth had to be reimagined to not only provide home access to healthcare providers but limit physician interaction with infected patients through remote patient monitoring at home and in the hospital.

At the beginning of the pandemic, BlueStar ISV partner VeeMed worked with healthcare system provider Banner Health to transform existing hospital TVs and displays into telehealth endpoints leveraging its virtual care platform. This allowed Banner physicians to gain instant feedback about a patient or conduct immediate telehealth sessions without having to expose themselves to the virus.

There was also a huge demand for temperature monitoring or screening to make sure anyone granted access into a hospital or building was not running a fever and putting everyone at risk. Video and photo editing software provider CyberLink redesigned its AI facial recognition technology solution FaceMe to take temperatures, check for proper-fitting face masks, and ensure social distancing, explains Whitting.

“You could do all this through walking through a gateway, so to speak, that had cameras on it and thermal sensors on it, and had AI capabilities built into it from a platform perspective, and be able to very quickly recognize whether this person was conforming with the requirements that were in place,” she says.

CyberLink was able to repurpose this technology for the healthcare industry by partnering with BlueStar, which brought together servers, cameras, and sensors from IoT supplier Advantech to FaceMe. The solution also leveraged Intel® OpenVINO for its AI capabilities and flexibility.

“We bring the piece parts together,” says Whitting. “We’re really trying to stay ahead of that curve, look at all the software entities out there and what they do, and how they can interplay with some of the other technologies that we offer.” 

The Future of Healthcare Solutions

For these technologies to continue to transform and add value to ongoing wants and expectations, it will take collaboration and partnership with hardware and software providers. Just as VeeMed did with Banner Health, BlueStar works with partners to analyze healthcare demands and understand net new growth opportunities. Whitting explains that just remote patient monitoring alone is going to be worth $117 billion by 2025.

“It’s really just more of engagement and networking with some of the key hardware providers, with some of the key software providers like VeeMed, for example, with their telehealth platform and understanding just some of the educational pieces of the technology,” she says.

Through BlueStar’s healthcare initiative VARMED, it identifies key players in the space, takes time to vet solutions, creates unique healthcare services, and educates and trains its partner community so they can feel confident these applications will be successful.

Whitting adds that BlueStar’s partnership with Intel has also been key in introducing new opportunities and onboarding different partners to build solutions.

“Our relationship with Intel continues to grow, coming out of a pilot to a tier-two aggregator, and part of that benefit has been the bilateral introduction of different software and hardware platforms that can be utilized to put together a solution. I think that’s been an invaluable part of our relationship thus far,” says Whitting.

Whitting expects to see more tools and technology that help healthcare providers retain staff, maintain operational efficiency, minimize potential patient errors, provide more convenience to care, and better access to information in the future.

About BlueStar

BlueStar is the leading global distributor of solutions-based Digital Identification, Mobility, Point-of-Sale, RFID, IoT, AI, AR, M2M, Digital Signage, Networking, Blockchain, and Security technology solutions. BlueStar works exclusively with Value-Added Resellers (VARs) to provide complete solutions, custom configuration offerings, business development, and marketing support. The company brings unequaled expertise to the market, offers award-winning technical support, and is an authorized service center for a growing number of manufacturers. BlueStar is the exclusive distributor for the In-a-Box® Solutions Series, delivering hardware, software, and critical accessories all in one bundle with technology solutions across all verticals, as well as BlueStar’s Hybrid SaaS finance program to provide OPEX/subscription services for hardware, software, and service bundles. For more information, please contact BlueStar at 1-800-354-9776 or visit www.bluestarinc.com.

A New Vision for VARs: An AI Playground in the Classroom

We live in a society increasingly dominated by AI, advanced technology, and automation. Whether we interact with curated playlists, shop online, or lean on streaming recommendations for the next show to watch, we unconsciously use AI.

Because of this growing ubiquity, schools across the globe have started to integrate AI capabilities into the classroom curricula to prepare elementary school-age students for the increasingly digital future. By doing so, teachers can immerse their students in safe AI-driven environments until the training wheels come off and they enter the real world.

But unfortunately, there are many barriers to adoption when it comes to applying AI to the education sector. Not only are there concerns around student privacy and budgets, but schools lack a clear strategy, the necessary talent to getting started with AI, and the commitment to apply it to their lesson plans.

Global Solutions Distributor BlueStar, Inc. takes a key role in removing these barriers. To start, BlueStar works with VARs to deliver out-of-the-box solutions that help educators modernize classroom technology. And the company backs up these solutions with service, support, and AI expertise.

Partnership Launches an AI-Based Classroom Solution

BlueStar also partners with ISVs like meldCX, which developed the AI Playground, a cost-effective and safe environment for students to experience and explore AI.

The AI environment is presented to students as a Lego-based competitive game. For instance, similar to building Legos, students are presented with brick kits that come in a range of levels—from a beginner pack of six to an advanced 100-piece unit—to create a model.

A camera is used to help guide students about where to place the parts. And to protect their privacy, the camera is situated to focus only on the students’ hands. Any faces are blurred at the edge, not captured or used in any way. In one example, students used kits to create a Mars Rover model, and once it was complete, they were able to use the playground’s software to “launch” it into space, have it land on Mars, and explore the surroundings (Video 1).

Video 1. With meldCX’s AI Playground, students created a Mars Rover model that they then launched into virtual space. (Source meldCX)

The AI software can stream educational information about the red planet, subtly making it a science-based learning lesson. Students can also compete against one another in timed events to see who can launch their model in the shortest amount of time.

Learning Lessons from the AI Playground

Such gamification is underexplored territory for schools, according to Joy Chua, Executive Vice President of Strategy and Development at meldCX.

“This is a rare opportunity to create awareness about what AI can do in the field of learning and creating knowledge out of data. At the end of the day, this is about empowering kids to learn how to collaborate with AI, and use it to build their skills, unlock creativity, and solve epic problems,” she says. Because gamified teaching is a welcome departure from the typical blackboard-driven instruction, students also enjoy this different learning approach, she explains.

Hands-on tactile learning can help in other ways, too. “Part of today’s education still doesn’t consider the multiple ways that students learn,” Chua says. Integrating AI into the Rover-building game, for example, can help educators accommodate both beginner and advanced students by tweaking the prompts delivered along the way.

This calibrated approach “allows people of all ages to learn at their pace and facilitates one-on-one attention to detail,” says Stephen Borg, Group Chief Executive Officer of meldCX. “It doesn’t alienate anyone; it doesn’t make anyone feel behind but will also make it dynamically more difficult if someone’s progressing really quickly.”

An Ecosystem of Partners Bring the Pieces Together

AI Playground was built in collaboration with BlueStar partners Intel and meldCX along with the University of South Australia. It leverages the meldCX vision analytics platform Viana to provide insights into the lesson. In the Mars Rover example, the game uses AI-based object detection programs to recognize the Lego bricks and the various stages of the Rover creation process.

Schools can get started with a basic web camera, a display screen, an Xbox controller, Lego bricks, and an Intel® NUC 12 Extreme Kit, which comes pre-integrated with the AI Playground software. The kit facilitates AI inference in the classroom in a small form factor since the NUC occupies less space than a traditional PC, Borg explains.

The value of the Intel partnership goes beyond hardware, according to Chua. Optimization using the OpenVINO toolkit at the edge facilitates quick detection of gestures and immediate delivery of feedback. “We have had synergies with Intel helping us by working with leading-edge technologies and making sure we’re on track to adopting best practices,” Chua says.

Additionally, the AI Playground solution abides by TRUSTe Enterprise Privacy & Data Governance Practices Certification, does not track faces or other identifying features, and students own their data.

meldCX has also created a range of packages to ensure the solution is accessible to all students, irrespective of learning styles. “We’re firmly ingrained with Intel’s AI for Youth vision, a program meant to empower youth with AI tech and social skills in an inclusive way,” Chua says. The AI Playground can be applied in a one-student-to-one device setting, one-to-few, or one-to-many.

Broader Applications of Vision Analytics

Beyond the elementary school classroom, object detection software like AI Playground can teach students in other subjects. For example, trade schools can demonstrate how to conduct tasks like assembling a car engine or fixing power lines. Anatomy labs can take apart and explore models of human bodies and learn how organs work together.

And beyond educational settings, object and gesture detection and recognition can find use in a number of industries. Hospital administrators can ensure that high-contact surfaces are cleaned appropriately, and meat packaging lines can use similar vision-based analytics to label packages accurately. Brands can conduct shopper behavior analysis—while still retaining privacy—to analyze buyer decisions and their relationship to product packaging.

Whether through solutions outside the classroom or inside it, Borg says, “We wanted to demonstrate that you can use AI safely and in a way that educates and informs. We wanted to help remove the negative perception of AI perpetuated by doomsday movies and let people see that there are many good applications of AI.”

“Our mission is to participate in the ethical practice of AI and bring it forward because we really see AI as a tool to augment human capabilities,” Chua adds. “As we’re moving towards a more digital future, it is important for us to empower our students to be first-class innovators, supported by second-class AI.”

And that’s a lesson educators take to heart.

About BlueStar

BlueStar is the leading global distributor of solutions-based Digital Identification, Mobility, Point-of-Sale, RFID, IoT, AI, AR, M2M, Digital Signage, Networking, Blockchain, and Security technology solutions. BlueStar works exclusively with Value-Added Resellers (VARs) to provide complete solutions, custom configuration offerings, business development, and marketing support. The company brings unequaled expertise to the market, offers award-winning technical support, and is an authorized service center for a growing number of manufacturers. BlueStar is the exclusive distributor for the In-a-Box® Solutions Series, delivering hardware, software, and critical accessories all in one bundle with technology solutions across all verticals, as well as BlueStar’s Hybrid SaaS finance program to provide OPEX/subscription services for hardware, software, and service bundles. For more information, please contact BlueStar at 1-800-354-9776 or visit www.bluestarinc.com.

The Latest in Data Protection? Confidential Computing

Sleight of hand works for magic tricks, but not for data protection. Yet such smokescreens are precisely what many enterprises unwittingly deploy in the name of information security. Companies might assume they keep data safe, but most protection mechanisms focus on data in transit or at rest—not while actually being used and processed, says Richard Searle, Vice President of Confidential Computing at Fortanix, a data security company.

For tightest security, enterprises need hardware-enforced trusted execution environments where data can be safe even while being processed, a practice known as confidential computing (CC), Searle adds.

Advantages of Confidential Computing Data Security

For years, companies in sectors like healthcare and finance have checked off security protocols by anonymizing data and thereby protecting patient or user identities. But, says Searle, anonymization of data with full integrity is very difficult to achieve. “Even if their personal information is masked using tokenization, it’s still possible to potentially resolve from datasets where they are sourced from and therefore the underlying identity,” he says.

Tokenization constrains data’s full use so not all functions can be executed smoothly. Even if data is encrypted while at rest or in transit, it is decrypted and not protected while being processed, making it vulnerable during this stage.

On the other hand, confidential computing works by unleashing the full potential of data while protecting it during all its states: rest, transit, and use. Another significant advantage of confidential computing is that it’s easier to follow the trail of breadcrumbs and provide necessary compliance documentation for auditors.

Confidential computing also strengthens implementation of Zero Trust architecture, a popular data security solution. Zero Trust demands segmentation of operations and verification of each step in an information processing chain.

“Confidential computing can help with that because it does two things: verifies the trusted execution environment where the data’s being deployed and validates the integrity of the software that’s being deployed there,” Searle says. “Along with other Zero Trust tools such as identity and access management tools for machines and users, confidential computing is an important technology because of the data protection services it affords within the network.”

“When you apply confidential computing, the data is only unencrypted within the confines of the TEE. It enables you to secure sensitive #data and applications when they’re being processed by the #CPU” – Richard Searle @fortanix via @insightdottech

Data Security with a Trusted Execution Environment

Confidential computing protects data in a trusted execution environment (TEE), a protected region of memory within the processor. These secure enclaves are encrypted with a hardware-managed key that the OS and hypervisor do not have access to. “When you apply confidential computing, the data is only unencrypted within the confines of the TEE. It enables you to secure sensitive data and applications when they’re being processed by the CPU,” Searle says.

The Fortanix CC solution is its Confidential Computing Manager, which acts as the middleware layer between enterprise applications and the underlying hardware and trusted execution environment. “For both on-premises and cloud deployments, the Manager also generates the necessary cryptographic proofs and validations required to attest that the information has been deployed securely and has been processed in accordance with legislative and organizational policy obligations,” Searle says.

The Role of Intel in Confidential Computing

Intel designed critical components needed for trusted execution environments, also known as “enclaves,” into its hardware/software solution stack:

  • Intel® Software Guard Extensions (Intel® SGX)
    Enables a protection perimeter around individual applications, allowing sensitive data to run securely and privately without needing to trust the underlying infrastructure and operating environment. Organizations can sandbox the software and data in a secure enclave using hardware-level encryption keys and trust certificates.
  • Intel® Trust Domain Extensions (Intel® TDX)
    Enables a protection perimeter around the Virtual Machine, allowing confidential computing with easy lift-and-shift functionality for existing virtualized workloads.

These technologies combine with 4th Gen Intel® Xeon® Scalable processors to enable a wider range of applications. “Modern processors like the 4th Generation Xeon are extremely powerful and have a large availability of memory for deployment of trusted execution environments so we can run very sophisticated enterprise-grade applications and AI systems,” Searle says. “I think that will facilitate growth in the adoption of confidential computing.”

Confidential Computing Use Cases

Confidential computing is especially useful for processing highly confidential data and where enterprises can’t guarantee the trust in the underlying infrastructure. Case in point: data migrations to the cloud “where you’re using someone else’s infrastructure platform and you don’t want the cloud administrators with root privileges to be able to access your information,” Searle says.

Use cases abound. For example, Fortanix is helping BeekeeperAI clients leverage confidential computing to securely deploy AI and ML models. BeekeeperAI helps researchers rapidly validate and iterate on models and enables secure collaborations among healthcare teams. And healthcare company Zuellig Pharma launched Digital Health Exchange, which uses confidential computing to enable data exchange across more than a dozen countries in the Asia Pacific region. “It’s another instance of how confidential computing can provide innovation in terms of data use and mobilization for different use cases,” Searle says.

While healthcare and finance are proving to be the initial testing grounds for confidential computing, implementations need not be restricted to these fields, Searle says. “The need to enhance your security posture really sets the scene for confidential computing,” he adds.

Next on the horizon: confidential computing use cases for edge AI. “We’re looking at how we can secure data at the edge in order to provide local processing on edge-based devices,” Searle says. The Fortanix Confidential Computing Manager can be pressed into service at the edge, too, because it takes care of hardware no matter where it is.

“The customer base is now receptive to the adoption of confidential computing; it’s going to lead to an increased demand for a deployment of the technology in specific use cases where data and applications need to be protected,” Searle says.

Whether that’s in the cloud or on the edge.

 

Edited by Georganne Benesch, Associate Editorial Director for insight.tech.

Distributed Computing Powers the Smart Grid

Blaine Mathieu is the face of changes reshaping the power distribution landscape.

His home houses a 30-kilowatt solar array on the roof that he uses to route electricity back to the grid. Mathieu, CEO of Pratexo, an edge computing software platform for utilities, is a “prosumer,” an individual who both consumes and produces electricity.

Such two-way energy flow is not the only change in utilities. To avoid global temperature increases and the worst fallout from climate change, the integrated energy system of the future must decarbonize. It must shift to 50-80% direct electricity by 2050 (instead of the 20% it is now), according to the World Economic Forum.

Decarbonization and the increase in electric vehicles are also adding unpredictability into the mix, Mathieu says. “As a result, we’re quickly moving away from the sequential, well-ordered centralized model of energy production to a decarbonized, decentralized, democratized, and digitalized one,” Mathieu observes, quoting recent Gartner research in this area.

The push-and-pull forces in power production are forcing the sector to move away from a mindset of viewing systems as being “built to last.” Instead, they need to be smart grids, “built for change,” Mathieu says. Such a mindset reboot is a radical transformation and “only software can enable that kind of rapid evolution and change,” he adds.

To accommodate the rapid evolution and change that they must go through, the utilities industry leans on asset-derived #IoT #data at the edge—where the sensors and machines operate. @pratexo via @insightdottech

Decentralized Power and Distributed Computing

To accommodate the rapid evolution and change that they must go through, the utilities industry leans on asset-derived IoT data at the edge—where the sensors and machines operate. The premise is that applying AI and machine learning-derived insights from IoT data streams will enable utilities to become more efficient.

And to gain these advantages, it is much more efficient to bring the algorithm to the data at the edge than the other way around. “When you’ve got hundreds of windmills generating gigabytes of data every day, you can’t possibly push all that into a central cloud,” Mathieu says. “Instead, what you should be doing is preprocessing some if not all that raw data locally, and then send only a lighter event stream of important events up to the cloud for further analysis.”

It’s a convincing argument for the deployment of distributed computing to deliver edge analytics.

The cost of moving data to and from the cloud is not the only factor influencing the move to distributed computing, Mathieu says. The grid needs to be constantly monitored and changes reacted to in a matter of milliseconds. In such instances, the low latency from distributed computing on the edge is also especially attractive.

Making Way for Electric Grid Evolution

Distributed computing might be the way for today’s decentralized power grids, but it lacks the seamless orchestration powers of cloud computing. In the distributed computing model, far-flung edge nodes close to the transformers in the field have to be managed and orchestrated remotely. Seamless it ain’t.

But with Pratexo, power utilities can have their cake and eat it, too: They can deploy a distributed computing model for the edge and still enjoy the orchestration and management ease of cloud computing, Mathieu says.

The Smart Grid in Norway

Norwegian utilities services provider Hallingdal Kraftnett (HKN) is a perfect example of the Pratexo Intelligent Energy Grid solution at work.

More than 70% of the vehicles in Norway are electric cars, which creates enormous strains on the grid. HKN manages more than 3,000 remote transformer stations and needs to respond to problems, if any, in milliseconds.

Because the Intelligent Grid Monitoring solution is a framework pre-architected and custom-made for grid monitoring with a set of dashboards, basic analytics, and integrations with hardware already in place, Pratexo simply had to mix-and-match a few Lego blocks to develop a custom solution for HKN.

The HKN drag-and-drop solution includes an integration with transformer equipment, an external power meter, humidity meter, and temperature sensor. It also uses a microphone that listens to transformer sounds to detect a crackling sound called partial discharge. An audio wave analyzer machine learning algorithm processes these sounds and alerts maintenance teams faster than standard manual inspection protocols.

Edge nodes at each substation process data locally, which are then routed to regional micro clouds formed across the remote transformer stations. Such decreased latency helps HKN deploy condition-based maintenance and react within seconds to problems. As a result, they avoid steep penalties that would result from outages.

All Pratexo deployments have been on the backs of Intel processors. “Virtually all of the software components and elements of the platform that we deploy were written to be compatible with Intel first,” Mathieu says, adding that the company has built an integration with the Intel® OpenVINO toolkit for AI processing of edge implementations in other applications.

The Future of the Electric Grid

The flexible and composable software that Pratexo delivers is what’s needed to pick up the pace in addressing climate change, Mathieu says.

“Instead of deploying a hardware and software architecture that is static and difficult to change, you shift your technology mindset toward composability, which means the ability to rapidly swap out and change or enhance individual components as necessary,” Mathieu says. This way we create a smart grid, easily adaptable to change.

“Software’s constantly changing. If we can adopt the best elements of software and apply it to utilities and electrification, that’s the only way we’re going to achieve the goals in front of us,” Mathieu says.

Which is a good thing, especially as the realities of climate change are becoming worryingly apparent by the day.

 

Edited by Georganne Benesch, Associate Editorial Director for insight.tech.

Next in Line: AI Solutions for Retail Environments

We’ve all been there: two items in your hand and what looks to be a twenty-minute wait for the checkout counter. (At least no one is paying with a check anymore.) Why, you think, with all the technological advancements we’ve achieved, are we still waiting in endless lines at the grocery store! Isn’t there a better way? There may well be. And, it turns out, it can do more in the store than just solve the problem of queue management.

The retail landscape has changed a lot in the past couple of years: Customer expectations have evolved, and so have the tools and technologies available to solve the pain points in a smart and meaningful way—many of them involving AI. Now, AI comes with a lot of opportunities and benefits, but many retailers are not in a position, or staffed with a development team, to develop and build these AI solutions, even if they know what they want to achieve with them.

Fortunately, there’s a whole ecosystem of implementation expertise out there, which is why Ria Cheruvu, AI Software Architect and AI Evangelist at Intel; and Nicole O’Keefe, Senior Product Marketing and Operations Manager at retail spatial intelligence solution provider Pathr.ai, are here to talk about developing AI retail solutions that really count (Video 1).

Video 1. Nicole O’Keefe from Pathr.ai and Ria Cheruvu from Intel talk about AI’s impact on retail operations and the biggest opportunities for AI solutions today. (Source: insight.tech)

What are the biggest challenges for retailers right now?

Nicole O’Keefe: Customers want that seamless checkout experience—short queues, short wait times. If they’re faced with long queues at checkout they can get frustrated, and it may come to a point where they just abandon their carts and leave the store altogether. That’s the last thing retailers want, and not only because cart abandonment leads to lost sales; it can affect customer loyalty too. They’re also concerned about labor shortages and rising labor costs.

All these factors are challenges we’re seeing in today’s retail space. It really presents the need for retailers to create, in particular, an efficient checkout experience for their customers.

How does AI address some of these pain points?

Ria Cheruvu: Artificial intelligence can definitely be helpful in terms of integrating multiple solutions and developing models around intelligent queue management and automated self-checkout. It can identify and provide understanding of the customer experience and integrate that into a system to provide valuable insights across multiple stores and customers. We’re seeing AI being helpful with scaling that process, too, as well as integrating all the different functionalities together.

How can developers successfully build and implement AI retail solutions?

Ria Cheruvu: It can be challenging, both because of the technical limitations of these models and because of the types of use cases that they’re trying to satisfy. Think of AI being able to count the number of items on a shelf, or identifying it when someone picks up an item and puts it into their basket. It can be integrated into things like a smart shopping cart, smart shelves, or smart robots. And actually a lot of times we can leverage models that are off-the-shelf or use technologies to train and build our own models, which does give us a lot of flexibility.

You do then need to bring in elements like privacy and security. I think there’s a really critical conversation to be had around how exactly we incorporate those things into the algorithms—whether that’s blocking individuals’ faces or respecting their privacy with regard to items they’re purchasing, and basically maintaining their anonymity while also extracting the insights needed to continue to improve the algorithms.

But with the number of AI technologies coming out and the improvements in them, it is becoming easier and easier to have those conversations pertaining to the retail space.

Nicole O’Keefe: At Pathr.ai we have a tagline: You can learn a lot from a dot. Every dot is a shopper moving around the floor plan, and that dot has no personally identifiable information attached to it. So retailers can really leverage privacy-preserving insights to make business decisions in a very unbiased way.

“Consumer behavior is shifting rapidly, and those #retailers who will just want to wait and see how it unfolds are going to be left behind. The time to act through #data is now” – Nicole O’Keefe, @Pathr_ai via @insightdottech

How are you working with retailers to implement these AI solutions?

Nicole O’Keefe: One of the ways we can implement AI is through spatial intelligence, which is all about measuring how people move and behave inside physical stores. We leverage a retailer’s existing camera infrastructure to provide insights throughout a store, in particular around checkouts—understanding how long the queue lines are and how long people are waiting—but in general around how the store operations are running. The goal is for those operations to run like a well-oiled machine and to make the experience for the customers as enjoyable as possible.

Retailers also want to reduce their operational costs and improve operational efficiency, and they can do so by leveraging these insights in a very data-driven way. It’s anything from allocating their resources more effectively to reducing unnecessary staffing costs. They can do things like understand how many registers are being used in a day, and if they’re not being used very often maybe it’s an opportunity to turn over that space to the sales floor and add more merchandise there.

Tell us more about Intel’s role in making these applications possible?

Ria Cheruvu: Our teams at Intel are passionate about building out technologies, but also about providing a foundation for our partners, like Pathr.ai, to then take those technologies forward and innovate on top of them. One of the approaches we’ve taken is around the OpenVINO toolkit, which provides a number of different optimizations and options for building and deploying AI models.

I also definitely point our partners to the OpenVINO notebooks GitHub repository, which has a wealth of information regarding how to get started with OpenVINO and how to build these applications. The way that we’ve designed these reference kits, tutorials, and notebooks is for a partner to basically take it, run it, and see the result. Then they can use it as an inspiration or a foundation to check out additional models, try them for their use case, deploy them on the edge devices that they prefer, and really take it on from there.

We’re also looking very closely at the end-to-end stack, and how Intel hardware can help accelerate a lot of the pipelines and large computational requirements that are required for these types of use cases, especially at scale.

What is the Intel partnership like from the Pathr.ai point of view?

Nicole O’Keefe: Intel has been such a valuable partner for Pathr as we’re scaling spatial intelligence in the retail world. We leverage the Intel® CPU-based edge servers, as well as OpenVINO for our computer vision. We’re able to deploy queue insights at scale in a very cost-effective and efficient way, and Intel has been there from the beginning for that.

How can you spread AI success across the entire store?

Ria Cheruvu: There are a number of different ways we can build on existing pipelines. We’re seeing the emergence of really popular and powerful object detection and classification models, but I would say that it even extends beyond that. There are additional models coming in, like pose recognition and activity recognition, that are helping us better understand how individuals are walking through a store and what they’re doing, which adds to the insights we’re able to get.

In addition, we really need to think about these AI models in terms of the preprocessing and the post-processing we do. For example, once we get those detections, what types of information can we extract from them—attributes and specific types of characteristics. What trends can we form from these models as well?

Zooming out from that, there’s a bigger picture in being able to assemble all of these models as part of pipelines—whether that’s validating outputs across a multiple-camera setup or appending the outputs from each pipeline as part of a dashboard for easier visualization.

Where do you see this space headed?

Nicole O’Keefe: It’s one of the most exciting things about working in AI in the retail space—figuring out where you’re headed. As customers we’ll continue to want that seamless experience while shopping. But for retailers it’s all going to be focused around optimizing their store operations. That could look like reducing staffing costs by using real-time alerts and understanding the real-time scenario—when do the checkouts need to be open and closed? And then making really data-driven decisions based on that information. If registers are not being used at that moment, maybe staff can be allocated to other areas of the store.

Another interesting trend, which Ria mentioned earlier, is self-checkout. A lot of retailers today are implementing self-checkouts alongside the more traditional checkouts with staff. Here at Pathr.ai, we’re able to empower retailers with insights around both staff checkouts and self-checkouts, and we’re able to help them understand the difference in performance between the two.

Where is AI in retail going, and what does that look like for developers and retailers?

Ria Cheruvu: When developers are turning to models and algorithms like YOLOv8 for object detection and classification, they’re definitely thinking about the bigger picture. And they’re better identifying how their solutions are fitting in a real-world environment—with all of the challenges and pain points that that can come with—knowing that AI models are still sometimes prone to failures no matter how performant and powerful they are.

In terms of the future and where Intel and our teams see spatial intelligence and the retail space going, we’re using existing types of algorithms, optimizing them, accelerating them, and accomplishing new types. We’re seeing a lot of experiences being transformed by AI, and we’re taking steps towards a point where everyone is comfortable with the way that technology is integrated into our environments.

One final takeaway that I would add is about women in AI, and developers who are female and who are driving areas in leadership—and to definitely continue pushing forward with that. With the democratization of these reference kits, and implementations that you can just plug in and use, I think that’s a very big motivation for being able to get started in the field. That’s something we definitely want to see more of in the AI space.

Nicole O’Keefe: Consumer behavior is shifting rapidly, and those retailers who will just want to wait and see how it unfolds are going to be left behind. The time to act through data is now. And one of the ways that they can stay ahead of the game is by using spatial intelligence with Pathr and with Intel. I think it’s a perfect combination.

Related Content

To learn more about developing retail technology, read The Future of Retail Technology Is Spatial Intelligence, listen to Streamline Retail Checkout with AI-Powered Queue Management, and join the OpenVINO discussion on GitHub to share your experiences. For the latest innovations from Intel and Pathr.ai, follow them on Twitter at @intel and @pathr_ai and LinkedIn at Intel Corporation and Pathr.ai.

 

This article was edited by Erin Noble, copy editor.

Transform Your Organization with Data-Driven Decisions

Businesses and organizations are filled with all kinds of data that could provide valuable insights into their operations and decision-making. But first they need a strategy and the proper tools and technologies in place to put it all in motion.

In this episode, we look at various data-driven strategies, challenges, and best practices from across industries. We also explore the key components of a successful data-driven culture, such as collecting and managing data, leveraging artificial intelligence and predictive analytics, and forming partnerships with other businesses. By understanding these concepts, businesses can harness the power of data to unlock insights and make informed decisions.

Listen Here

[Podcast Player]

Apple Podcasts      Spotify      Google Podcasts      Amazon Music

Our Guests: Awiros and Vistry

Our guests this episode are Saransh Karira, Head of Engineering for the video AI OS and marketplace Awiros, and Atif Kureishy, CEO and Founder of AI and automation retail solution provider Vistry.

Before founding Vistry in 2020, Atif worked as a strategic advisor for Accel Robotics, and was Vice President of Teradata. At Vistry, he focuses on providing restaurants with an intelligent platform to measure and improve their performance.

Saransh has been with Awiros for almost five years—in various roles such as Lead AI Engineer and Computer Vision Engineer—where he’s worked to build an ecosystem around the company’s video intelligence solutions.

Podcast Topics

Saransh and Atif answer our questions about:

  • (1:59) The meaning of data-driven cultures
  • (6:47) Technological advancements making data more accessible
  • (8:45) Successfully implementing a data-driven strategy
  • (12:20) AI’s role in creating data-driven cultures
  • (17:27) Lessoned learned from the industry
  • (24:41) Leveraging expertise from partners

For the latest innovations from Awiros and Vistry, follow them on:

Transcript

Christina Cardoza: Hello and welcome to the IoT Chat, where we explore the latest developments in the Internet of Things. I’m your host, Christina Cardoza, Editorial Director of insight.tech, and today we’re talking about data-driven cultures with a panel of expert guests from Awiros and Vistry. But before we dive into the conversation, let’s get to know our guests. Atif Kureishy from Vistry, I’m going to start with you. What can you tell us about yourself and your company?

Atif Kureishy: So, our company is two and a half years old. We’re a startup focused in the restaurant-automation space. I’m based here in Southern California, and we’ve really enjoyed our partnership with Intel and working at the edge, IoT, and computer vision, and excited to be here with you today, Christina.

Christina Cardoza: Yeah, excited to have you and to learn a little bit more about what you’re doing in this space. But first, Saransh Karira from Awiros, please tell us more about yourself and the company.

Saransh Karira: Hi, Christina. So, basically I head engineering at Awiros, and we are a startup based in India. And what we’re working on is building an ecosystem on top of a platform for radio-intelligence use cases.

Christina Cardoza: Great. So, I don’t think it’s a surprise to anybody listening or to you both and to  everyone in the IoT landscape these last couple of years that we’ve all been talking about how data is so important to business success today. It has all of these valuable insights that we need to gain and reach. But one thing that is sort of new is that businesses and organizations are now creating their cultures around data and talking—like we mentioned—we’ll be talking about this idea of a data-driven culture.

So I want to start the conversation there, and, Atif, I’ll start with you. When we say data-driven cultures, what are we really talking about? What’s the importance of this, and why is it something that businesses care about so much?

Atif Kureishy: Yeah, for me I think it’s simple, which is when I hear data-driven cultures it’s really about making decisions that are evidence based. So ones that are grounded in the understanding of data coming from your enterprise, being able to trust that data of course, and analyze it and derive key understanding from it. Then ultimately making decisions that drive strategic advancements, strategic initiatives, what have you. So that is kind of a broad-base statement.

You know, if I think about where customers have gone over my career I’ve worked with many Fortune 100 companies, let’s say, all over the world. And when I look back, first generation of a data-driven culture is really about data acquisition and data understanding. Can I acquire all the data that I potentially have access to inside my enterprise or outside, and then report on it frankly and just make sense of it to consumers and leaders that are interested in that information?

I think the second phase of that journey is kind of what we’ve been on for the last decade or so, or two decades, which is then starting to do prediction on top of that. And that introduces a lot of concepts, let’s say, in the machine learning space, if you will, around how to do that effectively and be able to explain and build confidence in those systems. And then really I think we’re on the third generation, and what the next gen is starting to look like is really with the introductions of these large language models. And rather than having very human data science, data-engineering-intensive activities, now moving towards really AI-based systems that tend to be smarter than us. And so how do we share a large corpus of enterprise data with those LLMs and do that in a trustworthy way to still make decisions that are informed in the enterprise.

So, somewhat of a long response, but that’s more from the technical perspectives. There’s for sure a people and organizational element of establishing that culture, but that’s, at least from my perspective, what I think of.

Christina Cardoza: I absolutely agree—those different evolutions or generations we’re seeing, it all started with computer vision and being able to see more into your business operations. But then we keep evolving real-time, artificial intelligence—just how we exactly see into those operations and how we’re collecting and managing and analyzing all that data, it just continues to change. And one thing that I think is really interesting about the data-driven-culture aspect is that it’s not just one industry we’re talking about here.

Vistry, I know you guys do a lot of work in the restaurant- and retail-automation space, but it’s really every business can benefit from data-driven cultures. And Saransh, I know you guys have a focus on video AI and enabling all of these AI applications across the various different businesses and industry. So I’m curious about what you’re seeing on your end and the customers that you’re working with, how they’re viewing this idea of data-vision cultures.

Saransh Karira: Yeah. So, I think in the last three to four years we have seen tremendous changes in the landscape. So let’s take an example: earlier there was the—data policies were like an umbrella term for any kind of data. Anyone if they hear that the data needs to be accessed for, let’s say AI training or anything, they were like, No, not possible.

But now all the customers—our customers, the business leaders—all the people are themselves becoming aware, and they know that the amount of data that you give to the system is the amount of precision that you get from the system. And so the data policies are now—now have clear boundaries, and the other side of the boundaries are very valuable for us, the amount of data that we can get from them.

Christina Cardoza: Absolutely. And I mentioned, Saransh, your company works with video AI, so obviously there is a video component that goes into it. We talked about the various different evolutions and generations of computer vision, so I’m curious to hear what advancements or evolutions are really making this possible—making data more accessible, making data more valuable, and just making businesses more easily able to succeed with these computer-vision AI applications. So Saransh, I’ll start with you again on that one.

Saransh Karira: Yeah, so I think first is, again, the changes in data policies: they themselves make the data a lot more accessible than they were before. So the raw data is the first step towards it. And now once we have this raw data, now applying intelligence on it just makes it more palatable. So now let’s say you have thousands of hours of data, like you just get an information overall even when you have access to the data, it’s not really accessible, like you cannot sift through it.

So that’s where the systems come in, the intelligence systems, the machine learning systems—all of those things come in and now, like Atif said, with the introduction of LLMs that’s just more palatable. I know one of my friends, so he’s working on a product; so what that does is you just train the product on the whole corpus of your laptop and you can search whatever the documents are. You just ask the questions and it will give you the answers. So, yeah, it’s changing very rapidly.

Christina Cardoza: Yeah. And that rapid change I assume can sort of create some challenges or complexity for businesses trying to implement these data-driven cultures and these strategies and efforts. You know, there’s so much data coming in now they have to be able to get the right information at the right time; they have to get real-time information; they have to maybe decide when and when not to store data to see the historical patterns or make predictions in the future. And so there’s a lot that goes into it: the technology, the camera systems, the AI, the edge, the cloud. So, Atif, I’m wondering what are the challenges that you really see businesses face. Where are the hurdles, and how can they overcome them?

Atif Kureishy: Yeah. Just a reminder—we are focused in the restaurant-hospitality space. So naturally when you think of that customer, it is a very people-oriented business, high velocity, and relatively unsophisticated. If you think about a restaurant environment, they are starting to make a lot more technology investments. But historically that’s not been the case. So, what we’ve seen in the challenge, number one, is that any type of capability that gets deployed and scaled across a large number of locations has to be very cost effective.

So this is where I think especially Intel has brought a unique value proposition, in the sense of you can run on commodity compute that’s been in existence there in the restaurant, or potentially deploy next-generation compute and have machine and deep learning models that can run effectively there at the edge. We position the Kubernetes runtime there, and so we have a lot of flexibility to provision and deploy different, let’s say, inference workloads that are running on camera-based data or other types of sensors.

And a lot of the things that we’re tracking are objects in the kitchen. So it makes for a unique environment, and for sure our training infrastructure has to be robust to be able to detect and track and be able to understand the activities that are occurring in the kitchen. So I think some of the key challenges in all of that—I mentioned the cost element of ensuring that that edge is robust and can be managed, let’s say, from a cloud-based infrastructure, and that you can get consistency across thousands of locations. And, again, that’s where some of the technologies around OpenVINO and deep learning tools that the Intel group has provided have helped tremendously. So, we can run our inference workloads on, let’s say, Intel Atom® tablets. We can run on, let’s say, i7 Tiger Lakes. We can run on the new Alder Lakes very easily and be able to optimize those runtimes effectively. So that’s been incredibly useful for us and for our customers.

Christina Cardoza: Absolutely. And I know you’re in the restaurant space, but I think a lot of what goes on in the restaurant or what you’re looking at in the kitchen really can relate to other industries—worker safety, inventory management, defect detection—these are all things that in the manufacturing space or smart cities, all businesses want to get insight into and to start seeing where they can make changes; what’s happening.

And a big part of that is artificial intelligence. These new AI models are making it happen, are being able to detect these in real time, and alert managers or operators at the right time and not give like a whole bunch of false notifications. They really are able to see, “This is something that I need to address immediately,” or, “This is something that I can see over time that I should discuss with my workers.”

So, Saransh, I’m wondering, because you work with a lot of AI applications, how are you seeing businesses being able to approach AI? And what really—as part of this puzzle of this data-driven culture—what really is the value of AI in these efforts?

Saransh Karira: Yeah. So, what we are seeing currently—first of all, again, the data policies are changing, and because of that a lot of infrastructure is being built for integrating a lot of data. So what I think the value and the value of data is is when you can connect a lot of different types of data. So, if you can take each data as a dot, and then if they can connect together the sum is more than the parts. So a lot of our customers are, let’s say, connecting throughout their different infrastructure or their different divisions, and across that you can go to one place and you can just get access if you are from—you belong to some other division, for example.

So that is one of the use cases, but it extends to a lot of different organizations—even we work with government extensively, and what we are seeing currently is they are connecting the vehicle preregistration with the cameras and then the passports. Everything is getting connected, and then the data becomes, the interconnected data becomes, much more valuable than the one system that is standing in just a silo.

Christina Cardoza: And I think a part of this data policy that we keep coming back to is data privacy and making sure, especially when you have cameras on people and you’re collecting all of this data, that we’re doing it in a safe way, that we’re not using the data in any other way than what the businesses intend to use it for. And I can assume that this is particularly, not challenging, but an issue that concerns, that people may have—especially in the restaurant space when you’re tracking people in the kitchen or you’re tracking customers. So, Atif, I’m wondering, what is—your history is AI data strategy—how do you ensure the privacy and the concerns of it?

Atif Kureishy: Yeah. So, first of all, I do, as Saransh mentioned, government has been on the forefront of at least integrating large amounts of data and ensuring the privacy and security, some better than others. I do have an intelligence background; so, I did work for the US intelligence community for several years. And I would say that that was a very large focus of ensuring that data handling and data privacy, data sovereignty, all of that was managed effectively.

To the question of in the restaurants in particular, we as a company don’t use any biometrics. So from that perspective there are no biometric features that are sensitive, and we’re very careful about any PII data that is collected. But generally we’re looking at objects—these may be vehicles, they may be people, but they’re not—they’re anonymized in some ways, and tracking of food products, of equipment, utensils, those types of things. So the data concerns are less, but they are still there for sure. And that workload and data storage and data transit in terms of what resides at the edge and what comes back into the cloud is thought through very carefully.

So, one aspect that I’ve mentioned several times is the inference—how do you actually get the answer of what you’re seeing and be able to react to that? And as you said, Christina, a lot of that is in the eventing or alerting or whatever you’re actually focused on. But then there is the aspect of training and fine tuning and taking that data and making your models more intelligent. And so that needs to be thought through carefully, because usually that’s acquired and consolidated, let’s say, in a cloud-based infrastructure to then support a model-retraining effort, and the data-security elements of that also need to be considered, very much so.

So in the most generalized form, if you’re not processing biometrics and you’re not looking at and storing PII, the problem domain becomes a little bit more straightforward. But data privacy, data access, just like in any SaaS-based product, has to be thought through very carefully.

Christina Cardoza: So, I’d love to hear more about how this all works in a restaurant space, or how you’re using AI and all of these technologies that we’re talking about to really create data-driven cultures and strategies for the customers that you help. So I’m wondering if you have any use cases or customer examples you can share with us: what the problem the customer was having, how you came in and helped them, and what can others learn from the challenges that you worked through?

Atif Kureishy: Yeah, a lot of what we see is these are dark spots, if you will, or parts of the business that are opaque to an above-the-restaurant leader. So let’s take the example of production control, which means you get—a restaurant essentially is a mini manufacturing site, I think, Christina, you said that earlier. And you know previously before starting Vistry we had worked in the industrial-manufacturing space, and so a lot of these concepts apply very directly. In a manufacturing sense you have measurement of inventory and you have QA and oversight of work products. And so if you apply that into a restaurant space, imagine that you have orders coming in; those orders can come in through digital, those orders can come in through the drive-through, they can come in through dine-in. And when those orders get acquired, let’s say they get consolidated into a kitchen that needs to essentially turn those orders around and manufacture, if you will, the orders correctly.

Now some of the areas of where AI is coming into play is can you create a production schedule like this is in the sense of a quick serve or fast food restaurant, where they pre-make certain products and they hold them, okay, so that when you make an order—as long as that menu item is being held in compliance, meaning it’s still fresh and it still doesn’t have any food safety issues—that is the ideal scenario, because you get your food as quickly as possible and that menu item ideally has been made in a compliant way. Where AI and ML come into play is how do I build and manufacture those menu items efficiently by predicting how many inbound orders I’m going to get and what type, and that allows the kitchen to be much more efficient, and not only from a labor perspective but also from a food-waste perspective.

The other aspect of where we’ve been using computer vision is on inventory management. And so having cameras that can look at a bowl or a pan and do volumetric estimation of how much product is in those pans can then help to inform a production schedule to say, “Hey, when there’s this many servings remaining and I predict this many new orders coming in, tell the cooks to start cooking more.” And that, again, from a lean-manufacturing perspective, that’s sort of like the just-in-time concept.

So those are some examples where you can start to look at computer vision and, again, that’s more from the supply side—so, modeling demand and then using AI to essentially ensure that the supply is there. Other mechanisms of computer vision is starting to use cameras to see how long the queue lengths are, both in the drive-through and the dine-in. And that is really about doing the demand modeling. So if I can see that there’s a stack of 12 cars, I can expect obviously they’re all going to place orders, I can then take that and input that into a prediction model and start to anticipate potentially what they’re going to order. And that is, in essence, how the optimization of the restaurant is taking place to be more data driven.

Christina Cardoza: Yeah, I love that example because when we talk about these data-driven cultures, it’s not just one aspect of a business’s operation, it’s all of these different aspects that you mentioned connected together to really create the best business flow and value as possible. You mentioned supply and demand, making sure you have all the inventory there, making sure that you have enough food to get through the day or to serve all the customer’s needs. And then making sure the kitchen is cooking the food, all the way out to customer service and quality, making sure food is fresh, it’s fast, they’re not waiting for it, and it’s the correct order. So it’s really an end-to-end production line connecting all these together and using data to drive all of that.

Saransh, I’m curious what kind of—outside of the restaurant space—if you could provide any customer examples or use cases of what you’re seeing, how you’re helping solve the pain points that you have dealt with with your users, and how others in the industry can get over some of those pain points.

Saransh Karira: So, over the years I think we have seen a lot of these use cases and a lot of these surprise ourselves as well. So, they extend across the different industries, and one use case was, I think there was this—basically there was this deployment where there were multiple different campuses, and for each campus there were multiple different access points or access sites. And the original implementation was just to see how many people are coming in, how many of them are visitors, how many of them basically have the access to the site, or how many of them are the first-time comers, so on and so forth. And that was the initial use case.

But the customer managed to use that to basically change the configuration of their security personal depending on where the people were; where the crowd fall was more they basically changed the security there and they reduced it from the other access points. So that was very interesting to see.

And other than that, I think we have seen a lot of these, basically what we can call meta-analytics; we have seen a lot of these in retail. So, in retail we have seen that basically the customers use that for, let’s say, there is a point where a lot of people are coming in. So it basically generates a heat map where the footfall is more, where it’s less, and depending on that our customer basically can change the configuration and the placement of the things, inventory management, and so on and so forth.

Christina Cardoza: Great. And one thing that comes to mind when we’re talking about all this, all the technology and the intelligence that goes into this, Atif, and you mentioned Intel a couple times throughout our conversation. I should mention that the IoT Chat and insight.tech as a whole, we are sponsored by Intel. But I am curious, because it always seems like when we are trying to create data-driven cultures or make things happen in the industry, these days not one company can do it alone. It’s really working with others and creating an ecosystem and leveraging technology and expertise from different companies to make this all successful and possible. So, curious how you work with partners like Intel. What’s the value of that, and how does that help drive, in this situation, data-driven culture? So, Atif, I’ll start with you on that one.

Atif Kureishy: Yeah, happy to answer that. You know, we are very thankful of our partnership with Intel and, as you mentioned, it takes a village, or it takes a broad ecosystem. So, around ODMs and OEMs that are providing the Intel base compute, working with the system integration teams out there that ultimately need to place these edge devices and sensors at the locations so that this processing can occur.

And then of course, having a cloud-based infrastructure, we work very closely with AWS, and so Intel is a key part of facilitating those dialogues and interactions with that larger community. And then of course the robust set of tooling and infrastructure that’s provided really around OpenVINO. So that’s been, that’s all been great for us. And it allows us to optimize, again, the types of processing that we’re running on CPU or on the IGPU—integrated GPU. There’s also good support of working with the open source community and the various deep learning frameworks that are out there. So that has been wonderful.

Christina, I want, if you would allow me, I would like to just go back to the previous question that you mentioned around data-driven cultures and use cases that are in the restaurant example, and we kind of threw around a few of them. I wanted to highlight what the historical culture is in the restaurant, because I think it’s important to understand that and how it makes sense that we’re now using data to serve the customer more effectively. And because the ordering infrastructure and loyalty—all of that is being generated digitally—it’s becoming easier.

But if we think about 20 years ago what the culture of a restaurant was, it was really reliant on the people and the managers that were running the restaurant and using their intuition of, “I expect a lunchtime rush today,” being aware of events that are occurring, catering events that are occurring—we’re expecting a field trip to come to the restaurant and 30 kids to show up, and we have the breakfast usuals that come in, and here’s how I’m going to place people.

So that’s been the last couple of decades of what working in the restaurant is, and especially with the pandemic all of that got turned upside down, because dine-in wasn’t the priority. Of course drive-through was still a key part of it, but digital became more essential, and now the kitchens and these restaurants are inundated and overwhelmed with trying to fulfill these orders. And so there is a need to essentially serve their customers and do all of this in a data-driven way.

And that is—I think that’s been the phenomenon that we’ve seen, which has been really exciting. So I just wanted to highlight that for the users, is that that is traditionally how—and, by the way, there’s a ton of restaurants, especially small restaurants and local restaurants, that still run that way. But when you look at the larger brands, they’re moving absolutely to more of this data-driven culture.

Christina Cardoza: Yeah, absolutely. And that’s a great point. Especially when you’re talking about quality of food and customer loyalty with things becoming digital, sometimes the customers never make it into the restaurant, or sometimes a third party is delivering their orders. So it’s that much more important that restaurants are on the top of their game, that they’re able to provide all of these services and make the customers happy.

So I think this data-driven culture is, as we move forward into the future, is going to become more and more valuable now that customer expectations are changing and the demands on businesses like restaurants are changing. There are going to be a lot of evolutions coming rapidly, I think, to some of these industries that haven’t taken advantage of some of the technology—now they’re really seeing the benefits of doing so.

And I think all the Intel technology that you said you were using, that’s really helping move all of this along—OpenVINO with the AI. And I think working with a technology giant like Intel, it’s also important not just for the technology that they can provide, but the partners and the ecosystems that we talked about that they can open you up to and connect you to others. So Saransh, I’m wondering how you’ve been working with Intel or other partners in this industry to make some of your solutions or use cases happen?

Saransh Karira: Yeah. So, as we’ve mentioned about ecosystem a lot of times in this chat before. So, I was also talking about with our platform we are trying to create an ecosystem of video-intelligence applications. And for that, the lower—so basically it starts with the hardware and it goes to use cases and then it goes to the marketplace. So the hardware is where Intel comes in. And then on top of it there are different use cases that are being developed by different researchers or any of the third-party developers, anyone. And on top of this there is a layer of marketplace which can be—which is basically visible to the end customers.

So in this hardware layer, the Intel community, the hardware, the software—all of these things have helped us tremendously. So, I think at the edge Intel is very cost effective for us, first of all. And the libraries have helped us a lot in optimizations. So there are different various amounts of optimizations, be it for inferencing—so, the actual part where the AI runs—as well as the decoding part of the video, and many other things. And Intel provides specific hardware for different operations like video recording and inference and all of these things. So, and also the support is very, very, very wide. So that’s what I think is where Intel has helped us a lot.

Christina Cardoza: Great. Well this has been a great conversation. Unfortunately we are nearing the end of our time, but before we go, we talked about different evolutions that have been happening in this space. I think that those evolutions are only going to continue as time goes on, as business needs change. So before we go, I just wanted to throw it back to each of you, any final thoughts or key takeaways you want to leave our listeners with when it comes to creating data-driven cultures and what the future of this looks like for businesses? Atif, I’ll start with you.

Atif Kureishy: Yeah, we touched on it a little bit. Really the GenAI space—ourselves, like everyone else, has sort of gotten on that bandwagon, if you will, and really worked extensively with models like GPT-4 for the last several months. And what’s interesting for us is a lot of our focus for the first couple of years has been generating, let’s say, dark data. How do we apply computer-vision workloads at the edge to create a data stream of physical observations? That’s really what we’ve been doing.

And that data then needs to be stitched into a larger baseline or foundation of data that’s coming from the point of sale, coming from inventory-management systems, coming from time-reporting systems, and so on and so forth. And so we’ve been looking at LLMs, large language models, to really interact with a larger and broader set of data and make sense of it. And the ability to do that very quickly is really fascinating and phenomenal. So, like nothing I’ve seen—especially being in the machine learning space for the last decade or decade and a half, it’s really exciting what the future looks like and how to very quickly position these capabilities to solve distinct problems.

So if I were to leave this audience with something is to—beyond ChatGPT and getting recipes and looking for travel itineraries and generating poems, which I’ve done with my kids and we have a lot of fun doing that—but it does really have big implications into the enterprise, and we’re excited to be a part of that journey.

Christina Cardoza: Absolutely. And I can’t wait to see what else Vistry comes out with over the next couple of years. Saransh, any final thoughts or key takeaways you want to leave our listeners with today?

Saransh Karira: Yeah. So I think my thoughts are very much in sync with Atif. So I think this new view of AI that has been coming and from the past few months is really exciting, and we should really watch it out what’s happening. So, there is a lot of different things that’s happening in the performance sector and LLMs especially, and a lot of generative, different AIs, and when it all works out and connects I just want to see what happens. So, yeah.

Christina Cardoza: Yeah, absolutely. And I would urge any of our listeners, if you’re looking to create data-driven cultures, get your efforts off the ground; you don’t have to do this alone. I would urge you guys to visit Vistry and Awiros websites to see how they can help you out because, like we mentioned, there’s a whole ecosystem out there and a lot of knowledge and help beyond that. So, just want to thank you both again for joining the conversation. It’s been very insightful and informative. And thank you to our listeners for tuning in today. Until next time, this has been the IoT Chat.

The preceding transcript is provided to ensure accessibility and is intended to accurately capture an informal conversation. The transcript may contain improper uses of trademarked terms and as such should not be used for any other purposes. For more information, please see the Intel® trademark information.

This transcript was edited by Erin Noble, copy editor.

Crowd Behavior Analytics Boost the Guest Experience

Real-time awareness of crowd movement and behavior is more important than ever as people flock to summer events—from local fairs to outdoor celebrations to international sporting competitions. The quality of the event experience at crowded venues depends on factors like food service convenience, simple wayfinding, and safety. Solutions using computer vision, AI, and tailored algorithms make it possible.

If you are at a concert or sporting event, you don’t want to miss a single thing. But sometimes nature calls or hunger strikes, and you must leave your seat and risk missing something important. Zack Klima, Founder and CEO of WaitTime, knows this struggle all too well. He will never forget the time he missed the Detroit Red Wings superstar Henrik Zetterberg score the winning goal for the team—all because Klima was in line to buy a few beers.

His first thought was, “This is ridiculous. There’s got to be a better way. It would’ve been great to know how long the line was before I left my seat.” That experience sparked the idea that eventually would become WaitTime, a company that uses AI and state-of-the-art imaging techniques to monitor and analyze crowd behavior.

Fast-forward and the company’s AI- and computer vision-powered WaitTime Crowd Intelligence platform is in use at some of the largest sports stadiums, shopping malls, entertainment venues, and airports. Owners, operators, and tenants benefit in a variety of ways, from crowd management to outstanding guest experiences, streamlined operations, lower costs, new revenue opportunities, and more.

Crowd Behavior Analytics Deliver High-Value Business Benefits

One example of the WaitTime platform at work is The National Exhibition Center, known more commonly as the NEC, Birmingham. It is the UK’s largest event space that hosts more than 500 events and 2.3+ million guests per year. The NEC is dedicated to providing top technologies to its clients, including granular business analytics and state-of-the-art operations intelligence. With WaitTime, the NEC Group can collect accurate occupancy figures, collect analytics for extreme crowd scenarios, and provide exhibitioners with detailed data reports to inform better business practices.

The Mall of America (MoA) in Bloomfield, Minnesota is perhaps the ultimate example of WaitTime behavior analytics in action. The venue is so much more than a shopping center; MoA is a pioneer in deploying innovative technologies to change the game of physical retail—for visitors, retailers, restaurants, and even the environment. This is extremely important when you are a top tourist destination with tens of millions of visitors coming each year. And at 5.6 million square feet, more than 500 stores and restaurants, and the nation’s largest indoor theme park, there’s a lot of ground to cover.

WaitTime #EdgeAI software—in combination with 700 cameras deployed in ceilings throughout the mall—can provide real-time capacity, crowd density, and shopper insights. @TheWaitTimes via @insightdottech

A recent Intel event at the Mall of America highlighted the unexpected benefits of crowd behavior analytics and how transformative solutions can be possible with the right partnership.

To start, it’s clear to see how WaitTime edge AI software—in combination with 700 cameras deployed in ceilings throughout the mall—can provide real-time capacity, crowd density, and shopper insights. This data helps remove the guesswork from how and where shoppers spend their time. And with the data at their fingertips, Patrick Wand, Sr. Manager – PMO at Mall of America, and his team can make more-informed decisions on advancing the visitor experience.

“We take all of these different disparate data sets and combine them into a model dashboard that helps us understand financially how we’re doing, and how efficient we could be moving forward,” says Wand.

Real-time information can also help mall operations take pre-emptive actions. For example, there is daily security presence at every one of the 47 entrances, but sometimes one officer isn’t enough. A predictably busy entrance may not always be thebusiest. “Through WaitTime we’re able to create a dashboard and redeploy security officers to areas more proactively,” says Wand.

“And we know with greater than 95% accuracy how many people are in the mall, at any point in time, and which entryway they’re coming in from,” adds Klima.

Factors like weather can have a direct impact on mall traffic. Wand points out that two inches of rain on a Saturday, combined with big store sales and other events, generate almost as many visitors as Black Friday. “If we know an upcoming Saturday will bring in more than usual visitors, we can communicate to our tenants through an app so they can proactively staff their stores,” he says.

Edge AI Powers Crowd Management

The brainpower behind WaitTime crowd analytics includes four algorithms that support different use cases—with greater than 95% accuracy:

  • The queuing algorithm was designed around the company’s initial solution idea to measure unstructured queues. It tracks the speed and direction of each moving object—information that helps vendors add staff or add checkout options.
  • Conversely, the stanchion algorithm is for structured queues like you might find at a Starbucks. The software draws a perimeter around the area and excludes anything outside of it. This information also helps determine where best to add staff.
  • The entry/exit algorithm is the one of most highly leveraged at the mall. It monitors with precision and in massively high volumes how many people are entering and exiting simultaneously in real time.
  • Unlike the others, the massing algorithm uses a side view to monitor how full an area is becoming. For example, WaitTime deployed this algorithm at the US Open Tennis Championships—pointing the cameras at the grandstand to track seating capacity—making it easier and faster for people to find seats.

But real-time analytics require performant edge computing, and WaitTime is optimized to run on Intel hardware. And using the Intel® oneAPI programming model helps WaitTime develop more efficiently while elevating its heterogeneous workloads to achieve the highest possible performance.

“We try to make our software as efficient as possible where we can run most of the cameras just using a single thread,” says John Mars, WaitTime CTO. “So, as the processors get more powerful, they get faster, and have more cores to handle more cameras with basically no changes to our initial architecture. If we can make it as fast as possible, then everything else happens for us automatically.”

Crowd Management Takes a Village

The technology leadership and business innovations you see at Mall of America can happen only through partnerships like those between Mall of America and its solution providers. They’re the key to making deployments successful.

Along with Intel and WaitTime, Cisco and its broad range of solutions are also essential to successful Mall of America solution deployments. “We’re a Cisco shop as it relates to compute,” says Wand. “That goes from the edge all the way to the core: our wireless access points, our network backbone, and all of our switches.”

“When Mall of America forms a partnership, the goal and objectives must be aligned,” says Wand. “How do we stretch the limits on how we use our technology, how do we find a goal, and how do we find an objective mutually so that we’re achieving great things together?” This goes for Cisco, Intel, and WaitTime.

From Wand’s perspective, it’s not just about having partnerships with one given company. It’s about how together, they help Mall of America operate the business to deliver on its overall goals—today and into the future.

 

This article was edited by Leila Escandar, Editorial Strategist for insight.tech.

This article was originally published on July 26, 2023.

Streamline Retail Checkout with AI-Powered Queue Management

Long wait times and slow checkout lines have become all too familiar in retail stores. With each passing second, customers grow increasingly frustrated, leading to a negative impact on customer satisfaction, store business, and reputation. In today’s fast-paced world, shoppers no longer tolerate such experiences.

Fortunately, recent advancements in AI have opened doors to developing solutions that can significantly improve store operations and enhance customer journeys. But lack of in-house development resources poses a challenge for many retail stores looking to implement these innovative solutions.

In this podcast, we explore the shifting landscape of customer expectations, innovative ways AI is used to address retail challenges, and skills and knowledge necessary to build, deploy, and implement AI across retail stores.

Listen Here

[Podcast Player]

Apple Podcasts      Spotify      Google Podcasts      Amazon Music

Our Guests: Intel and Pathr.ai

Our guest this episode is Ria Cheruvu, an AI Software Architect and AI Evangelist at Intel, and Nicole O’Keefe, Senior Product Marketing and Operations Manager at the retail spatial intelligence solution provider Pathr.ai.

Ria has been with Intel for five years in various AI roles from AI Research engineer to AI Ethics Lead Architect. Prior to her role at Intel, she taught AI and machine learning courses, and was a Teaching Fellow at Harvard University.

Nicole has been with Pathr.ai for more than two years, and has held various marketing and research roles at Bluefield Technologies and Kidder Mathews.

Podcast Topics

Ria and Nicole answer our questions about:

  • (1:59) Changing customer expectations and retail challenges
  • (4:01) How retailers can become more actionable with AI
  • (5:24) Building, developing, and deploying AI retail applications
  • (8:22) AI’s business value and benefits for retailers
  • (10:59) Tools necessary for developing AI applications
  • (12:07) Where developers can get started building solutions
  • (14:30) Successfully implementing AI solutions in stores
  • (15:36) Creating an end-to-end retail operations solution
  • (18:23) Continuing the success of AI in the retail space

Related Content

To learn more about developing retail technology, read The Future of Retail Technology Is Spatial Intelligence, check out Intel’s AI Reference Kits, and join the OpenVINO discussion on GitHub to share your experiences. For the latest innovations from Intel and Pathr.ai, follow them on Twitter at @intel and @pathr_ai and LinkedIn at Intel Corporation and Pathr.ai.

Transcript

Christina Cardoza: Hello, and welcome to the IoT Chat, where we explore the latest developments in the Internet of Things. I’m your host, Christina Cardoza, Editorial Director of insight.tech. And today we’re talking about developing AI retail solutions that matter with two special guests, Ria Cheruvu from Intel and Nicole O’Keefe from Pathr.ai. I’m very excited to dive deep into this topic. But before we get started, let’s get to know our guests a bit more. Ria, I’ll start with you. What can you tell us about yourself and what you do at Intel?

Ria Cheruvu: Sure. Thanks, Christina. Hey, everyone. I am an AI Software Architect at Intel Corporation and an AI Evangelist. I’m very passionate about being able to speak about, develop, and build cool things in the AI space. I’ve also got a master’s in data science, so, pretty much interested in all things AI.

Christina Cardoza: Great, excited to hear what you have to say about the retail space. But before we get into that, Nicole, what can you tell us about yourself and Pathr.ai?

Nicole O’Keefe: Hi, everyone. Thanks so much for having us on the show. I’m Nicole O’Keefe, I’m a Senior Product Marketing and Operations Manager at Pathr. I lead our marketing efforts here at the company and also project manage all of our deployments. And really excited to dive deep on this topic.

Christina Cardoza: Perfect. Excited to have both of you here with us today. Like I teased in my intro, talking about retail solutions that matter. You know, AI comes with a lot of opportunities and a lot of promises and benefits. So sometimes I feel like businesses or organizations can just be wanting to implement AI, to implement an AI.

But today I want to talk about really solving the pain points and the challenges that we see in the retail space, and how we can implement these solutions in a smart and meaningful way. So, Nicole, I’ll start with you with the conversation. Obviously the retail landscape has changed quite a bit over the last couple of years. Customer expectations have evolved. So, curious from your side of things, what are you seeing in this space? How is it creating challenges for retailers? Where are their biggest pain points on retail floors today?

Nicole O’Keefe: Yeah, I think that’s a great question to start us off with, Christina. You know, as customers we want that seamless checkout experience—I think short queue lines, short wait times. Imagine going to the store, you just finished shopping, and you’re faced with long queues at the checkout. And I think a lot of us have been in that position before, and you start to get frustrated. You think you’re going to spend even longer just waiting in line, and it may come to a point that you just abandon your cart and leave the store altogether.

Now, for retailers that’s really the last thing they want for their customers, because cart abandonment can lead to lost sales; it can affect their customer loyalty. And on top of that they’re concerned with rising labor costs and labor shortages in the workforce. And all of these factors are really contributing to the challenges that we’re seeing in today’s retail and in the retail world. And it really presents the need for them to create an efficient checkout experience for their customers.

Christina Cardoza: Yeah, absolutely, and I certainly agree. Nothing is more frustrating than wanting to run into the store to just grab something really quick and then having to wait on line. It puts a bad taste in your mouth, sometimes, with that store, that retailer.

So I know we also have self-checkout solutions that have been implemented, but that doesn’t really solve the problem. Because sometimes you don’t scan something right; you have to wait for a store operator or a cashier to come help you. Sometimes they’re helping with a different member. So there doesn’t really seem to be a good solution right now, or it’s a pain point I can definitely see in the retail space.

So, Ria, I’m wondering how does AI come and start to address some of these pain points for retailers and try to make this more actionable?

Ria Cheruvu: Definitely, and I think, Christina and Nicole, as you shared earlier it’s just so fascinating to see how these pain points turn into actionable solutions that we can propose. I think one of them, Christina, you just mentioned is basically the integration of different solutions that we would need to apply.

So, artificial intelligence and the solutions that it’s powering are definitely very helpful there where you’re able to integrate multiple solutions and develop models around automated self-checkout, intelligent queue management, identifying and better understanding customer experience, and integrate that into a system that’s actually providing you with valuable insights across multiple stores, customers, and scale that. So we’re really seeing AI helping with that scaling effort, as well as integrating all of these different functionalities together.

Christina Cardoza: So we know sort of what we want to implement in the retail space and why we want to do it, but how do we actually go about doing this? A lot of times retailers, they don’t have the development team on staff that are able to build these AI solutions. AI, it’s becoming more accessible, but I think to implement these and to really make it valuable it’s still a little bit more specialized the way that we do this.

So I’m curious, Ria, if you can expand on how you’ve seen developers build these solutions, or how developers can successfully build these type of applications and work with a retailer to implement it in a way that not only solves the retailer’s problem but they’re building these applications that address the customer expectations, privacy, and security that some of these users may have.

Ria Cheruvu: It can be a challenging question both from the technical limitations of these models and also the types of use cases that they’re trying to satisfy, and then bringing in the different domains like privacy and other elements. I think, just speaking to the first two first, there’s definitely a lot of models and solutions out there that can be put to the test when it comes to these use cases.

We can think of being able to identify the number of items in stock on a shelf, or identifying when someone picks an item off the shelf, puts it into their basket. Even something that really fascinates me is the way that we can integrate AI in the different options, whether that’s a smart shopping cart, smart shelves, smart robots that are kind of monitoring and zooming through the store and multiple different elements. And really a lot of these times we can leverage models that are off-the-shelf and also use technologies to train and build our own models, which gives us a lot of flexibility as to how much time and commitment we want to put into this.

Just briefly speaking to privacy and anonymity and a lot of these security and other elements as well, I think it’s a really critical debate and conversation around how exactly do we incorporate those themes into these algorithms, and also how do we use these algorithms for those purposes as well. For example, whether that’s blocking individual’s faces, respecting their privacy with regard to items they’re purchasing, and basically maintaining that form of anonymity while also extracting the insights needed to continue to improve these algorithms.

So it’s definitely something of a major theme around this, but we are seeing with the improvement and the number of AI technologies coming out that this is becoming easier and easier and allowing us to have broader conversations for the retail space.

Nicole O’Keefe: Great point, Ria. So, protecting consumer privacy is really top of mind for retailers today. Here at Pathr we have our tagline: you can learn a lot from a dot. And every dot is a shopper moving around the floor plan, and that dot has no personally identifiable information attached to it. So retailers can really leverage these privacy-preserving insights to make business decisions in a very unbiased way.

Christina Cardoza: One of the things that I loved what you said in the beginning of your response is we’re solving queue management with these intelligent queue management systems and these AI solutions, but it doesn’t stop there. You can take a lot of these algorithms and apply it to different use cases and improve other areas around the store. So, want to get into that a little bit more.

But before we get there, Nicole, I’m curious I know, Pathr.ai has experience and a history of working with retailers to implement some of these solutions. So what are the business value and benefits you really are seeing when you work with customers, how you guys are implementing AI?

Nicole O’Keefe: Yeah, no great points, Christina. And I think Ria touched on some really key thoughts earlier, around how are retailers and developers implementing it today. And I think one of the ways they can do that is through spatial intelligence. And spatial intelligence is all about measuring how people move and behave inside physical stores.

Here at Pathr we leverage retailers’ existing camera infrastructure, and we’re able to provide insights throughout their store and in particular around their checkouts. Understanding how long are the queue lines? How long are people waiting? And so for retailers it’s really important for them to kind of narrow down to: I want to reduce my operational costs; I want to improve operational efficiency.

And when they leverage these insights they’re doing so in a very data-driven way. They’re leveraging AI to make these decisions that really impact the growth of their business. Anything from allocating their resources more effectively, reducing unnecessary staffing costs, and they can even understand from a register point of view how many registers are being used in a day. And if they’re not being used often, well, maybe it’s an opportunity for them to turn that space into the sales floor and add more merchandise there.

Christina Cardoza: Yeah, those are some great points. And I love that we’re not only—with spatial intelligence you can not only see these queue lines and deploy more workers, but this can be used throughout the whole story, really creating a data-driven culture and end-to-end experience that you can see where the foot traffic is, where the products are at stock or low, or where it makes more sense to put certain products. So you can really start improving just by adding one piece, and starting with intelligent queue management you can really start building onto it and improving retail operations.

And of course I have both Intel and Pathr.ai on the podcast today because this is not something that I think one company can do alone. At insight.tech we always talk about this theme of “better together.” I think it really takes partnership and ecosystem expertise from other organizations to really be able to do this in a meaningful and successful way.

So, Ria, I’m wondering how Intel not only helps developers build these applications but how do you guys work with partners to make sure that companies and partners like Pathr.ai can really deploy these for their customers in a meaningful and valuable way?

Ria Cheruvu: Absolutely. So, our teams at Intel are very passionate about being able to build out technologies and also provide foundations for our partners like Pathr.ai to then take that forward and then innovate on top of. Some of the approaches that we’ve taken are definitely in terms of the software approach with Intel OpenVINO toolkit providing a number of different optimizations and options for being able to build and deploy your AI models.

We’re also looking very closely at the end-to-end stack and how Intel hardware can definitely help accelerate a lot of the pipelines and large computational requirements that can be required for these types of use cases, especially at this scale.

So those are the two elements I’d say that we’re definitely very, again, passionate about and happy to help our partners with taking that further and then innovating with their customers and for their use cases.

Christina Cardoza: And I know Intel, you guys also provide a lot of resources and notebooks for developers to get started with this. So where would you point developers? How could they get started building an AI solution that is really going to be implemented in a scalable and flexible way across businesses—but where do they start? How do they start learning and practicing and building these algorithms and models and working with OpenVINO and getting more familiar with that Intel hardware that you talked about?

Ria Cheruvu: Sure. I definitely point them to the OpenVINO notebooks GitHub repository, which has a wealth of information regarding how to get started with OpenVINO, how to build these applications—production grade, because it’s always fascinating and very convenient to have both your learning journey and also your production, deployment, and scaling journey integrated into one experience.

So we’re really excited to be able to share that resource with the audience, with developers who are interested. And basically the way that we’ve designed these types of reference kits, tutorials, and notebooks is for you to basically take it, run it, get started, see the result. And then use it as an inspiration or a foundation for you to then check out additional models; try it for your use case; deploy it on the edge devices, for example, that you prefer; and really take it on from there.

Christina Cardoza: Awesome. And, Nicole, I’d love to hear from Pathr.ai side how the value of working with partnerships, how you guys have been working with Intel—are you guys leveraging any of the technologies that Ria mentioned? And what it’s been like on your side developing these intelligent queue-management applications and implementing them with retailers with Intel as a partner?

Nicole O’Keefe: Yeah, absolutely. Intel has been such a valuable partner for Pathr as we’re scaling spatial intelligence in the retail world, and we leverage Intel’s CPU-based edge servers and OpenVINO, like Ria mentioned, for our computer vision. And we’re able to deploy queue insights at scale in a very cost effective and efficient way. So Intel has been there from the beginning. So, excited to continue as we scale spatial intelligence.

Christina Cardoza: Awesome. And what is the relationship like from Pathr.ai when you guys work with end users and retailers? We have Intel being there providing the technology and the hardware, being able to really help make these solutions and developers build these and deploy these and make these possible. So, where does Pathr.ai come in? When you’re working with a retailer how are you guys developing solutions and really implementing and deploying them across multiple stores?

Nicole O’Keefe: Yeah. I mean, we work closely with our retailers to really understand what are their challenges that they’re facing right now. And so, around the checkout experience retailers want to understand how often are registers being used? How long are queue lines? And how long are shoppers waiting? And so all of these factors really help them gain even more insight into, how are your store operations running? And really the goal is for them to run like a well-oiled machine, make the experience for customers as enjoyable as possible.

Christina Cardoza: Great. Now, we talked about using spatial intelligence to do some of this. Some of the use cases, Ria, you mentioned, I’m assuming you use object detection and other AI capabilities and algorithms. So I’m curious if you can talk a little bit more about what are the AI algorithms or the machine learning models that make this possible? And, like we talked about, how does this go beyond intelligent queue management? How do we start building on the success that we see with one implementation and really spreading it across the store?

Ria Cheruvu: Sure. I think there’s a number of different elements that we can do to build on these existing pipelines. We’re seeing the emergence of really popular and powerful object detection and classification models. But I would say that it even extends beyond that, Christina, and I’m sure Nicole can also share additional insights on it. But there’s additional models coming in, like pose recognition and activity recognition, that are helping us better understand how individuals are walking through a store, what they’re doing, that are helping add to the insights that we’re able to get with these models.

In addition, I think that there’s also a world that we really need to think about around these AI models in terms of the pre-processing and the post-processing that we do. For example, once we get those detections, what’s the type of information that we can extract—including attributes and specific types of characteristics that we can get, trends that we can form from these models as well?

And I think, really zooming out of that, the bigger picture is taking a look at how we can assemble all of these models as part of pipelines, or, again, interacting with each other for a lot of different use cases. Whether that’s just checking and validating each other’s outputs across a multiple-camera type of setup, or, again, as I mentioned earlier, being able to append the outputs from each of these pipelines as part of a dashboard for easier visualization.

But, overall, just to summarize what I’m saying, the emergence of new models, the kind of elements that come outside of it for post-processing, extracting insights, or even the things that we can do to help the models, like defining zones for intelligent queue management or potential parameters that we can preset—these kinds of elements are definitely helping put together the bigger picture for the use cases that we can start to see.

Christina Cardoza: One thing that I think is really interesting when we’re talking about these use cases and these improvements to their retail stores, it is really non-intrusive to the user. They don’t know, they don’t feel the impact—well, they feel the impact with getting the lines shorter, but they don’t have any experience cut out, because they’re now—retailers can see: Oh, I need another cashier open so that we can start spreading out some of the lines. It’s not going to be a hindrance on their shopping experience because—

I just think of sometimes retail implementations that I’ve seen to date, that little robot that’s going around the store following you everywhere that you can’t seem to escape that is just trying to find, like, spills or any hazards on the floor. But these are really adding AI that is making improvements that the customers will feel, but it’s not going to get in their way and it’s not going to intrude on their shopping experience.

Nicole, I’m wondering where you see this space headed: How can we continue the success of AI in the retail space? What’s still to come? Where do the opportunities still lie ahead? And how does Pathr.ai plan to be part of this future?

Nicole O’Keefe: Yeah. I mean, that’s such an exciting question. It’s one of the most exciting things about working in AI in the retail space, is figuring out where you’re headed. A few things come to mind here. So, as customers we’ll continue to want that seamless experience while shopping—short queue lines and wait times.

But for retailers it’s all going to be focused around store operations. How can we optimize our operations in-store? I mean, this could look like reducing their staffing costs, working with real-time alerts, and understanding a real-time scenario. When do the checkouts need to be open and closed? And then really making data-driven decisions in a way that, hey—if registers are not being utilized, well, maybe we can allocate that staff to other areas of the store.

Another interesting trend that we touched on earlier was self-checkouts. A lot of retailers today are implementing self-checkouts alongside the more traditional staff checkouts. And here at Pathr we’re also able to empower retailers with insights around staff checkouts or self-checkouts, and help them understand the performance between these two.

Christina Cardoza: Great. Well, it’s been a great conversation with you guys. I think we are running out of time, but before we go I just wanted to throw it back to each of you any final thoughts or key takeaways you want to leave our listeners with. Ria, I’ll start with you. What should developers know about AI in retail stores? Where is this going? How they can prepare? And where else Intel sees this space going?

Ria Cheruvu: Sure. I think it’s a very exciting space. I think you can see Nicole’s enthusiasm when she’s talking about the problem statement, and that’s definitely something that we share at Intel—the enablement, the strategy, and also the enthusiasm that developers can get when they’re solving problems that they have faced in real life and know that they can create innovations and solutions that can do better.

I think definitely when developers are turning to models and algorithms like YOLOv8 or these types of models for object detection and classification, definitely thinking about the bigger picture and better identifying how their solution is fitting in a real-world environment with all of the challenges and pain points that it can come with. Knowing that AI models are still sometimes prone to failures no matter how performant and powerful they are.

I think these are a lot of insights that I personally learned as part of my developer journey, and something that we’re working towards as a community. I’d say, in terms of the future and where Intel and our teams see spatial intelligence and the retail space going, we’re seeing a lot of these experiences being transformed by AI, and continuing to see that as well. And we’re taking steps, I think, to getting to a point where everyone is comfortable with the way that technology is integrated into environments, and we’re reaching a level of ease and convenience that we want to accomplish with new types of algorithms. We’re using existing types, optimizing them, and accelerating them.

Christina Cardoza: Well, I can’t wait to see what else Intel does in this space. I know that you guys are actively trying to improve your solutions and make things easier for developers, make things easier for partners. OpenVINO just had the 2023.0 release, where you guys really listened to developer feedback and pain points and added some more capabilities that make it easier to develop these solutions. So, can’t wait to see how that continues to expand in retail as time goes on.

Nicole, any final thoughts or key takeaways you want to leave us with today?

Nicole O’Keefe: Sure. I mean, this has been such a fun and engaging conversation with you both, so thanks for having me on the show. I’ll leave our listeners with this today. You know, consumer behavior is rapidly shifting, and those retailers who will just kind of wait and see how that unfolds are going to be left behind. And, really, the time to act through data is now. And one of the ways that they can stay ahead of the game is by using spatial intelligence with Pathr alongside with Intel. I think it’s a perfect combination.

Ria Cheruvu: And one final takeaway that I would add definitely for women in AI and developers who are female and who are driving areas in leadership is to definitely continue pushing forward. There’s definitely a lot of available technologies out there. And with the democratization of these reference kits, implementations that you can go ahead and plug and use, I think that that’s definitely a very big motivation for being able to get started in the field.

So that’s also something we could definitely want to see more of in the AI space. So I definitely recommend developers who are women, who are minorities, who want to really get out there and see their voices being heard, consider driving your innovations in the retail space and getting started there.

Christina Cardoza: Yeah, absolutely. Great point, especially on a podcast where we have three women in different leadership spaces representing their companies. I think that it’s great to see, and I would love to see more faces like us developing these solutions and being part of this AI and retail movement.

So, with that, I just want to thank you both again for the insightful and informative conversation. And thanks to our listeners for tuning in. Until next time, this has been the IoT Chat.

The preceding transcript is provided to ensure accessibility and is intended to accurately capture an informal conversation. The transcript may contain improper uses of trademarked terms and as such should not be used for any other purposes. For more information, please see the Intel® trademark information.

This transcript was edited by Erin Noble, copy editor.

The Rise of EV Technologies and Charging Stations

Electric vehicles (EV) seem to be everywhere these days—on the streets and in the media. Businesses, governments, and even utilities provide incentives for people to make the switch to electric. And, particularly in some urban areas, charging stations pop up like mushrooms. It’s great news for all kinds of concerns about fossil fuels, as well as all kinds of technology innovations.

But this EV transition-in-progress also has big implications for both energy usage and the state of the power grid. Technology has a lot of pressure on it to make the former sustainable, and infrastructure has a lot of pressure on it to make the latter reliable—for tomorrow’s demands as well as today’s. Maurizio Caporali, Chief Product Officer of the developer of leading-edge solutions SECO; and Ezana Mekonnen, Chief Technology Officer of the energy systems provider Imagen Energy, join us to discuss the rise of electric vehicles and charging stations, and the industry support required to support that evolution (Video 1).

Video 1. SECO and Imagen Energy discuss what’s standing in the way of EV technology becoming truly mainstream. (Source: insight.tech)

What’s driving the rise of, and the interest in, electric vehicles?

Maurizio Caporali: Electric vehicles are a solution that has changed the automotive industry a lot in different ways. In general there is a breakdown with respect to the combustion engine solution. For sure, electric vehicles don’t use fossil fuels—so there’s possibly a reduction of pollution in specific environments, and this could be very important.

Then there are many aspects interesting for the end user. For example, driving comfort. Electric vehicles are something that is very quiet, and also it’s a change from the vibration point of view. Less maintenance, because this kind of solution needs less maintenance on the part of the components and there’s less failure on the part of automotive movement.

Another very important consideration is from the technological side: Electric vehicles have a lot of technology inside. It’s a complex environment—with computers, many sensors, and more technology than, in general, is in the standard combustion car. The last point, from a technological point of view, is the improvement of battery technology.

In some ways we can think also about electric vehicles in relation to self-driving cars. For example, the possibility to interact with the electric vehicle remotely—the possibility for the end user to have all the information about the car in a smartphone application. Also the control—the possibility to turn on the air conditioning before entering the car, for example.

What is the impact of electric vehicles on the power grid?

Ezana Mekonnen: I think the impact of electric vehicles on the grid is profound. This is by way of added demand; if not managed correctly, it can add a strain on the grid. But when it comes to the grid, it’s not always a demand-side problem. We see similar issues when we introduce PV solar power into the grid, and an excess supply of energy causes the same kind of strain.

It’s the balance of supply and demand that’s critical. And this is done through smart loads—smart grids that can better coordinate the supply and demand—and then also added storage in the system so that it can better buffer the energy coming from renewables as well as the demand needed by electric vehicles.

What kind of infrastructure currently exists for charging solutions?

Maurizio Caporali: First we started with electric vehicles; now we are thinking about the infrastructure of charging stations. The key point is to permit the growth of electric vehicles, but without the charging stations, this change will not be possible.

“The key point is to permit the growth of #ElectricVehicles, but without the charging stations, this change will not be possible.” – Maurizio Caporali, @SECO_spa

Our interest is in the fast-charging station—to give the opportunity to the end user to charge the vehicle during the trip in only a few minutes. And also to give the possibility to have information about the positioning, about the availability of the charging station, and about the characteristics of the charging station with respect to the car.

To do this there are important aspects that are related to technology—technology that is not only hardware but also software. We have analyzed this aspect and defined a solution that can work with the physical space and the ambient in different ways—on the one hand, with sensors to understand the status of the ambient environment, on the other hand, having an interface for the end user and the capability to give information to the end user.

EV chargers could also be a very important point of interest in the sense of data. Charging stations can produce a lot of data for the end user, but they can also be an important point of information for municipalities. So they are not only the way to charge a car but also a data-information system.

Another important point is managing fleets of these charging stations. With the change from fossil fuel to electricity, we need to guarantee the ability to charge the car. Also to have all the necessary information ready and available immediately with predictive-analysis information about the status of an entire fleet of charging stations.

How is SECO working to get charging stations installed on highways or within cities?

Maurizio Caporali: The important aspect here is the flexibility of the solution so that we can give a company the opportunity to customize the last level of that solution. Our characteristic is to define something that is very flexible and very modular, then give the opportunity to customize.

The other important aspect is to make this customization available from the hardware point of view and also from the software point of view. Then we give customers a set of tools to define the right service and right solution for different levels of user. There are the parts that manage the maintenance of the infrastructure, and there is also the marketing side—the possibility to manage remotely the information, the pricing, the advertising system. We give the opportunity to add a large screen for information, to add a payment system, to add many sensors that can enable different levels of service depending on the place where the device will be installed.

How can we ensure today’s efforts continue to scale and evolve?

Ezana Mekonnen: I think there are two parts to that. The first one is that it’s very crucial to have a long-term view of what we’re actually deploying. For instance, we are developing our charger to be bidirectional—not because that’s needed now, but because we’re making sure that the infrastructure is in place for not only charging a vehicle but also being able to pull the energy back to the grid. This will turn EV from being a liability to the grid into an asset for the grid, where we’ll have what are essentially batteries on wheels, right?

The second aspect is that EV charging owners worry about what they call “stranded assets,” where they have charging stations that don’t get enough usage. So we have an architecture that can allow us to deploy a charging station and then add charging ports to it as the utilization goes up. This will help the infrastructure keep up with the adoption of electric vehicles, and it can continue to grow.

What is the relationship between SECO, Imagen, and other companies?

Ezana Mekonnen: At Imagen we realized that these chargers won’t just be chargers: They’re multifunctional units. It’s similar to how our phone is not just a phone but also a camera, a GPS system, and more. So while we were focused on making a compact converter that’s sufficient for power conversion and delivery, we looked to SECO for added functionality. And that’s functionality such as its CLEA AI—the capability for image processing and audio processing, and then being able to drive a large screen for advertisement that could potentially either offset the cost of charging or provide functionality. And not just functionality for the user of the EV charger but also for the business around it. Basically we think that having this infrastructure out there with a lot of processing capability could evolve to something else beyond just charging.

And Intel has also been just great in terms of the technology that it’s offering us—specifically an FPGA that we’re using for our power conversion. It’s a very reliable and robust method of developing power conversion, especially as we try to make it efficient and extremely compact. It takes more than any one single company to develop this future infrastructure, and we’re happy that we’re working with both SECO and Intel.

Maurizio Caporali: Yes. The core part of our technology is based on an Intel chip. In particular we are using the last generation of industrial solution from Intel—the low power consumption that is based on the Atom® series processor. These processors are very flexible, very powerful, and with very, very low power consumption.

Another important point is that, with the possibility of analyzing a lot of complex data that is coming from different kinds of sensors, all this data can be analyzed in real time. That gives also the opportunity to not have to send all the data to the cloud, but instead it can be pre-analyzed directly on the edge device. And this is possible thanks to the technology also of OpenVINO. Our solution also has industrial-grade efficiency in the sense of temperature and also long life—the possibility to maintain the solution for more than 10 years.

Also, as I mentioned before, there is the possibility to define this solution as a modular one, and the possibility to have a series of interfaces and IOs. For example, we have a direct connection with the electronics of Imagen Energy to exchange the data between the two systems in the right way, in the perfect way.

This collaboration—the solution of Imagen, related to the power efficiency of the energy conversion; and our solution, managing all the data on top of the creation of energy—has given us the opportunity to interface with the current, the infrastructure, and also the managing of all human interface, all based on a big screen to provide all the information for the end user.

Any final thoughts for us?

Ezana Mekonnen: This is just an exciting time—this big, big revolution happening with the conversion of transportation into electric. It can bring about a lot of new opportunity, new markets, and a more sustainable future.

Maurizio Caporali: Yes, and the change will happen soon—the possibility of using electric vehicles in the right way, with a new generation of more efficient EV charging. It’s more simple and more smart for the future of charging and traveling. And this could be very important for new possibilities related to the interaction between the end user and the environment.

Related Content

To learn more about electric vehicles, read AI and CV Power Up the EV Charging Station Boom and listen to Powering Up EV Technologies: With SECO and Imagen Energy. For the latest innovations from SECO, follow them on Twitter at @SECO spa and LinkedIn, and follow Imagen Energy on LinkedIn.

 

This article was edited by Erin Noble, copy editor.

IPCs and Virtualization: The Future of Smart Factories

Industrial PCs (IPCs) have been instrumental in advancing Industry 4.0. They’ve helped manufacturers move away from hard-to-manage, proprietary programmable logic controllers (PLCs) to software-defined industrial control applications running on open systems like Windows and Linux.

The upside has been enormous. But manufacturers are still looking for better ways to gather and analyze data from the factory floor, unify their technology stack to improve efficiency, and facilitate IT/OT convergence.

IPCs are a natural first step on the road to the smart factory, but early versions lacked the flexibility to take full advantage of the possibilities offered by virtualization technologies.

These powerful edge computing systems enable agile and rich data acquisition—while also being easier to manage, more cost-effective, and more flexible than proprietary systems of the past.

New IPC Platforms—New Edge Benefits

Multi-purpose IPC platforms like those designed by Shenzhen Datang Computer Company, a manufacturer of IPC systems offer the advantages of traditional industrial computing systems: high-performance, low-power processing, high availability, ruggedized design, and an excellent platform for real-time analytics.

But the real magic of these platforms is the performant computing they deliver to run modern software virtualization technologies, enabling multiple workloads to run on a single system. There are consolidation and security benefits as well since software developers can easily port their existing industrial applications to the latest IPC technologies—taking advantage of hardware and software stacks improvements.

This also reduces complexity and costs, making it easier for factory personnel to maintain and monitor systems factory wide. Plus, depending on the underlying platform, multi-purpose IPCs can add value through a unified suite of software tools that deliver better insights into factory data, optimize performance, and speed development work.

Datang’s platform, for example, leverages specific Intel industrial software technologies:

  • Intel® Edge Controls for Industrial (Intel® ECI), a modular software reference platform that enables a multi-purpose ICS to run on general-purpose hardware. Intel ECI significantly reduces the difficulty of upgrades and updates for manufacturers. The platform also supports real-time analytics capabilities, virtualization for workload integration, and configurable software modules to meet the performance demands of industrial computing, reduce costs, and improve flexibility.
  • Intel® Industrial Edge Insights Platform (Intel® EII), an open-source software platform for IIoT applications that offers data collection, storage, analysis, visualization modules, and containerized deployment. Optimized for Intel hardware and integrated with the Intel® OpenVINO toolkit, Intel EII accelerates the development of edge AI solutions, offers better insights into data, and helps businesses get to market faster.

For Datang, using Intel technology has been crucial. Intel is unmatched as a performant, stable hardware platform for industrial edge computing. And their software tools have been just as important in shortening our development time and bringing our solution to market.

Virtualization—the Platform for Software Defined ICS

In addition to helping manufacturers move to open systems and consolidate their hardware/software stack, multi-purpose IPCs offer another significant advantage: built-in virtualization technologies that run on a unified, easy-to-manage platform.

The benefits of virtualization for industrial computing have been apparent for some time now—for example, as a means of upgrading infrastructure without disrupting operations.

Virtualization is, first and foremost, a powerful way to separate computer resources from their underlying hardware. It also improves cybersecurity since computing systems can be subdivided more easily into discrete security environments. But perhaps the greatest benefit of virtualization is workload consolidation—putting idle computing resources to use, improving efficiency, and reducing costs.

The greatest benefit of #virtualization is workload consolidation—putting idle computing resources to use, improving efficiency, and reducing costs. @MaxtangPC via @insightdottech

Multi-Purpose IPCs and the Future of Industrial Control

In the years to come, flexible industrial computing systems that incorporate virtualization technologies will attract more and more attention in the manufacturing sector.

In part, this will be because of advancements in the field of industrial computing. For example, Datang is already looking into integrating Type 1 hypervisors into their products. Also known as “bare metal” hypervisors, Type 1 hypervisors run directly on the underlying hardware without needing a host operating system. This allows for more efficient resource allocation, improved performance, and better security. The benefits in a manufacturing context are perhaps self-evident—but with the growth of IIoT, even more attractive Type 1 hypervisor and virtualization technologies are on the horizon.

One exciting possibility is the ACRN reference hypervisor, an open-source virtualization tool that is purpose-built for embedded IoT development. ACRN hypervisors solve data center issues that manufacturers find particularly burdensome: lengthy boot times, high costs, and significant development overhead. ACRN will help move Industry 4.0 closer to open-platform, software-defined industrial computing.

But the main draw of multi-purpose IPC platforms will be how well they solve problems for multiple stakeholders.

For OEM/ODMs, the ease of development offered by modern IPC platforms means they can focus on meeting manufacturers’ needs without having to worry about steep R&D costs. And for builders and operating technology systems integrators, who tend to deal with smaller batch orders, development costs will also come down thanks to the flexibility and customizability of these platforms.

For the manufacturers, of course, the advantages are crystal clear. Multi-purpose IPC platforms offer simpler, easier-to-manage access to all those benefits that motivated their digital transformation in the first place: real-time control, improved product quality, reduced costs, and a faster route to innovation.

 

Edited by Georganne Benesch, Associate Editorial Director for insight.tech.