arrow-left

All pages
gitbookPowered by GitBook
1 of 8

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

How to use your Custom Vision model in a Power App?

Once you are happy with you model's performance, you can add it to a new app by choosing Use model and New app.

You will be redirected to Power App editor and an Object Detection component that uses your model will be added automatically. In the editor, you can add new pages to navigate, design and customize your pages.

Once you are happy with the design, you can publish and share your app. You can use your new app by downloading Power Apps from , or stores. Once you sign in, your app will be listed in the mobile Power Apps.

Applearrow-up-right
Androidarrow-up-right
Microsoftarrow-up-right
Use your model in a new app
Your AI model used in the Object Detection component
Power App in Android Play Store

How to improve Model performance?

Getting the best model performance for your business can be a rather iterative process. Results can vary depending on the customizations you make to the model, and the training data you provide.

To help facilitate this process, AI Builder allows you to have multiple versions of your model so you can use your model and continue to improve it at the same time.

hashtag
What are some best practices for training for object detection?

  • Use diverse images to train with all possible use cases. For example if you are training your data to detect a VR headset, use images of the headset used in different environments as well as the out of the box images. If you only train with images with people wearing the headset, your model would not recognize images of the same device when it is in its box.

  • Use images with variety of backgrounds. Photos in context are better than photos in front of the neutral backgrounds.

  • Use training images that have different lighting. For example, include images images taken with flash, high exposure, and so on.

  • Use images of objects in varied sizes. Different sizing helps the model generalize better.

  • Use images taken from different angles. If all your photos are from a set of fixed cameras such as surveillance cameras, assign a different label to each camera. This can help avoid modeling unrelated objects such as lampposts as the key feature. Assign camera labels even if the cameras capture the same objects.

hashtag
How to share your models?

By default, only you can see the models you create and publish. This feature allows you to test them and use them within apps and flows without exposing them.

If you want others to use your model, you can share it with specific users, groups, or your whole organization.

What's next?

Now you have your app's prototype, you can add more features, get feedback and test your app.

hashtag
Should I keep using my power app or rebuild it?

When your needs change, you can consider refactoring your application to a serverless backend and a custom built UI. If the app is working fine for you and your users, you can continue using and improving overtime using Power Apps.

What would be the changes that requires the upgrade? There are two possibilities for the changed requirements for your app:

  • Feature

  • Budget

  • hashtag
    How to create a custom feature for Power Apps?

    Ready made tools are always limited to the features the product team decides to include. If you are writing custom code, you can add any feature that you need. Thankfully, for the features that are not implemented yet, it is always possible to author a custom connector that you can use with or without Power Apps.

    A connector is a proxy or a wrapper around an API that allows the underlying service to talk to Microsoft Power Automate, Microsoft Power Apps, and Azure Logic Apps. It provides a way for users to connect their accounts and leverage a set of pre-built actions and triggers to build their apps and workflows.

    Check out the list of Power Apps Connectors arrow-up-rightand how to build a custom connectorarrow-up-right yourself.

    hashtag
    How to compare costs for Power Apps and Logic Apps?

    Once you start using your app, you will have a better idea about the number of users accessing AI capabilities and the number of images that you need to train. You can use AI Builder Cost Calculatorarrow-up-right and Logic App Cost Calculatorarrow-up-right to compare options. You can check any other service price through Azure Product Cost Calculatorarrow-up-right.

    Headset training data in different environments and varied objects
    HoloLens training data
    HoloLens and VR headset data with different background
    HoloLens training data with low light
    HoloLens training image with different size and angle

    How to detect objects from images?

    To start creating your AI model for your app, sign in to Power Appsarrow-up-right and click on AI Builder on the left hand menu. Select Object Detection from the "Refine Model for your business needs" option.

    Build Object Detection on Power Apps - AI Builder

    Name your new AI model with a unique name. Select Common Objects and proceed to next section.

    Train your custom model screen for Object Detection

    Name the objects that you are going to detect.

    Name each objects to be detected

    Upload images that contain the object you will detect. To start with you can upload 15 images for each object.

    Make sure each object has approximately the same amount of images tagged. If you have more examples of one object, the training data will be likely to detect that object when it is not.

    Tag your objects by selecting a square that your object is in and choosing the name of the object.

    Once you are done choose Done Tagging and Train. Training process will take some time.

    If you choose to not use an image or clear any tags, you can do that at any time by going back to your model under the AI Builder on the left hand side menu and choose your model and choose edit.

    AI Builder will give you a Performance score over 100 and a way to quickly test your model before publishing. You can edit your models and retrain to improve your performance. Next section will give you some best practices to improve your performance.

    How to create a no code AI application using Power Apps and Custom Vision?

    A fast and easy way to prototype apps with AI capabilities

    Shortlink:

    You might have an idea for an application using AI and not have anyone to build it. You might be a programmer and want to try out your ideas and before you start writing code. No matter what your coding skills are, if you want to prototype an application with AI, and it's feature is a fast and easy option.

    This article explains what the power platform is as well as goes through a step by step process to create an app that detects objects from photos using and Check out the video below to see the app we will build to detect different Headsets such as HoloLens version 1 and 2 Augmented Reality and Virtual Reality headsets and their hand controllers.

    Read or skip through the questions to learn how to build your first Power App with AI features.

    • What is Power Platform?

      • What are Power Apps?

      • What is AI Builder?

    hashtag

    https://aka.ms/NoCodeAIarrow-up-right
    Azure Custom Visionarrow-up-right
    Power Platformarrow-up-right
    AI Builder arrow-up-right
    Power Appsarrow-up-right
    AI Builder.arrow-up-right
    Mixed Realityarrow-up-right
    Training image format and size for object detection
    False positive HoloLens 2 detection
    Tagging objects
    You can choose to not use images after you upload and tag them.
    Performance score of trained model

    What are some of the use cases for AI Builder?
    Is AI Builder the right choice?
    Can I use Power Apps and AI Builder for production?
    What will my production app cost?
    What is Object Detection?
    How to try out Object Detection capabilities?
    What can you do with Object Detection?
    How to detect objects from images?
    How to improve Model performance?
    What are some best practices for training for object detection?
    How to share your models?
    How to use your model in a Power App?
    Where to go next?
    Should I keep using my power app or rebuild it?
    How to create a custom feature for Power Apps?
    AI and Cognitive Services Resources
    What are the preview features?
    How to compare costs for Power Apps and Logic Apps?

    What is Power Platform?

    Power Platform is a set of tools, API's and SDK's that helps you analyze your data and build automations, applications and virtual agents with or without having to write any code.

    Power Platform features

    hashtag
    What are Power Apps?

    Power Apps is a set of tools that allows you to create applications with a drag and drop UI and easy integration of your data and 3rd party APIs through connectors.

    A is a proxy or a wrapper around an API that allows the underlying service to talk to Microsoft Power Automate, Microsoft Power Apps, and Azure Logic Apps. It provides a way for users to connect their accounts and leverage a set of pre-built actions and triggers to build their apps and workflows. For example, you can use to get tweet data and visualize it in a dashboard or use to send your users text messages without having to be an expert in Twitter or Twilio APIs or having to write a line of code.

    circle-info

    Check out the to see all the APIs that are available. Notice or might not be the same.

    hashtag
    What is AI Builder?

    AI Builder is one of the additional features of Power Apps. With AI Builder, you can add intelligence to your apps even if you have no coding or data science skills.

    hashtag
    What are some of the use cases for AI Builder?

    You can use pre-trained models to:

    • Detect objects from images

    • Analyze your customers sentiment from feedback

    • Detect keywords from text

    Extract specific information about your business from text

    connectorarrow-up-right
    Twitter connectorarrow-up-right
    Twilio connectorarrow-up-right
    list of connectors for Power Appsarrow-up-right
    Power Automatearrow-up-right
    Logic App connectorsarrow-up-right
    AI Builder Features on Power Apps
    Object Detection App made with Power Apps

    What is Object Detection?

    AI Builder Object detection is an AI model that you can train to detect objects in pictures. AI models usually require that you provide samples of data to train before you are able to perform predictions. Prebuilt models are pre-trained by using a set of samples that are provided by Microsoft, so they are instantly ready to be used in predictions.

    Trained custom model result with AI Builder

    Object detection can detect up to 500 different objects in a single model and support JPG, PNG, BMP image format or photos through the Power Apps control.

    hashtag
    How to try out Object Detection capabilities?

    You can try out and see how object detection works before having to create and accounts or apps yourself on the page.

    hashtag
    What can you do with Object Detection?

    • Object counting and inventory management

    • Brand logo recognition

    • Wildlife animal recognition

    Azure Computer Visionarrow-up-right
    Try out Computer Vision capabilities with your own images

    Is AI Builder the right choice?

    How to decide if Power Platform and AI Builder is the right choice for what I want to build?

    Great question! There are so many tools out there and many ways to do the same thing. How do you know which one is the right solution before investing time and effort?

    I have a rule of thumb when I want to build something, use whatever is available and easy to use first. When your needs exceed what the tool you are using covers, look into another solution or building it yourself.

    circle-info

    Use the tool easiest to get started when you are building your idea. When your needs exceed the capabilities of the tool you are using, find a solution that enables you. Don't invest in building things from scratch before you know it is worth it to do so.

    For example, if you have an app idea, it is better to have a prototype running as easily as possible. You can test your ideas before investing your time into building custom designed UI or features. In our specific case, you can first prototype your app with the drag and drop UI of Power Apps and using prebuilt AI models. When your specific needs surface, such as recognizing a particular object or keyword, you can invest your time into creating your custom models to train for the object or keyword detection.

    hashtag
    Can I use Power Apps and AI Builder for production?

    Yes you can. As any tool that does things magically, AI Builder in Power Apps comes with a cost. That does not mean you can't .

    hashtag
    What will my production app cost?

    If you want to go to production with Power Apps, it is a good idea to consider the costs. Thankfully there is an app for that. let's you input what AI tools you will need and how many users will be accessing your app's AI features and gives you the price it will cost you.

    hashtag
    What are preview features?

    AI Builder was released for public preview on June 10, 2019 in Europe and the United States. Preview release features are subject to change and may have restricted functionality before the official release for general availability. Preview releases are not meant for production use. You can try them out and influence the final product by giving feedback.

    The General Availability (GA) release will occur in a phased manner, with some features remaining in preview status while others are released for GA. You can check out the release status on the .

    try your ideas out for freearrow-up-right
    AI Builder Calculatorarrow-up-right
    AI Builder documentationarrow-up-right
    AI Builder cost calculator
    AI Builder Preview features notice