[PAID] MlTBRek: Offline Text and Barcode recognition using ML Kit [$8 or 551]

vknow360 · September 3, 2023, 3:56pm

1. Overview

The MlTBRek extension for App Inventor 2 and Kodular enables offline text recognition and barcode scanning using ML Kit. This extension offers modules for barcode and text recognition, including support for various scripts such as Latin, Devanagari, Chinese, Japanese, and Korean. Users can initialize text and barcode recognizers, install and check the availability of necessary modules, and recognize text or barcodes from images, file paths, or content URIs. The extension also provides events for handling module states, recognition results, and errors, making it a powerful tool for integrating advanced recognition features into your apps.

Latest Version: 4
Released: 2023-09-02T18:30:00Z
Last Updated: 2024-08-28T18:30:00Z
Aix Size: 1.2mb

2. Blocks

3. Docs

Events

ModulesInstalled	Event raised when modules have been installed _{type \| number}
ModulesInstallFailed	Event raised when modules installation failed _{type \| number errorMsg \| text}
ModulesStateUpdated	Event raised when modules state changes _{type \| number state \| number progress \| number}
GotModulesState	Event raised after checking modules availability _{type \| number areModulesAvailable \| boolean}
RecognisedText	Event raised after getting text from image _{text \| text blocks \| list}
UrlScanned	Event raised if url was found in barcode _{title \| text url \| text}
ContactInfoScanned	Event raised if contact info was found in barcode _{address \| text email \| text name \| text orgName \| text phone \| text title \| text urls \| text}
EmailScanned	Event raised if email was found in barcode _{address \| text body \| text subject \| text type \| number}
WifiScanned	Event raised if wifi info was found in barcode _{ssid \| text pswd \| text encryptionType \| number}
GeoPointScanned	Event raised if geo points were found in barcode _{lat \| number lon \| number}
BarcodeScanned	Event raised when no specific type of barcode was found and given barcode was decoded in general _{rawValue \| text barFormat \| number displayValue \| text}
BarRecognitionFailed	Event raised if barcode scanning failed _{errorMsg \| text}
TextRecognitionFailed	Event raised if text recognition failed _{errorMsg \| text}

Methods

BarRecognitionModules	Modules for barcode recognition
TextRecognitionModules	Modules for text recognition _{langScript \| number}
InitTextRecognizer	Initialize Text Recognizer _{langScript \| number}
InstallModules	Install deps of given type _{type \| number}
ReleaseModules	Initiates a request to release given modules when they are no longer needed. This method notifies Google Play services that the modules are no longer needed for this app, but it does not guarantee the modules can be removed. Google Play services will try to clean up the modules when they are not used by any apps. _{type \| number}
CheckModulesAvailability	Checks given modules availability _{type \| number}
RecogniseText	Tries to recognize test from given input that can be an Image component, file path or content uri _{image \| any}
InitBarRecognizer	Initializes Barcode recognizer/scanner
RecogniseBarcode	Tries to decode barcode from given input which can be an Image component, file path or content uri _{image \| any}

Properties

DefaultScript	Property Type : read-only Accepts : number
DevanagariScript	Property Type : read-only Accepts : number
ChineseScript	Property Type : read-only Accepts : number
JapaneseScript	Property Type : read-only Accepts : number
KoreanScript	Property Type : read-only Accepts : number

4. Usages

Install required modules

Check modules availability

Text Recognisation
First initialize recognizer.

Then provide input image to RecogniseText block.

RecognisedText event will be raised with result if recognition was successful otherwise TextRecognitionFailed event will be raised with error message.

blocks is a list of dictionaries. Each dictionary contains following keys:
- text : complete text
- lines : a list of lines
- angles : a list of angles corresponding to each line
- confidences : a list of confidence values corresponding to each line

All major language scripts are supported.

Latin
Devanagari
Chinese
Japanese
Korean

Barcode Recognition

Initialize Barcode recogniser.

Then provide input image to RecogniseBarcode block.

Result will be delivered via different events based upon type of barcode.

It reads the following barcode formats:

1D barcodes: EAN-13, EAN-8, UPC-A, UPC-E, Code-39, Code-93, Code-128, ITF, Codabar
2D barcodes: QR Code, Data Matrix, PDF-417, AZTEC

It automatically parses QR Codes, Data Matrix, PDF-417, and Aztec values, for the following supported formats:

URL
Contact information (VCARD, etc.)
WiFi
Geo-location (latitude and longitude)

more will be added on demand.

5. Demo Video

6. Purchase

Thank you.
Hope it helps!

Carlos_Andre · September 4, 2023, 2:26pm

Is it possible to read license plates?
here in Brazil, the signs (image attached) have information about the city and state.
How can I not read this information?
placas

vknow360 · September 4, 2023, 2:54pm

Yes it can.

I can provide a demo apk if you want.

Anil-Kumar · September 4, 2023, 5:06pm

Provide Apk We Will Test

ShanmugaNathan2023 · September 4, 2023, 5:25pm

Tested and Extension works fine

vknow360 · October 10, 2023, 8:49am

Beta testing for upcoming version has been started.
So, ML Kit upgrade on the way within a month.
I am by far the laziest extension developer.

ShanmugaNathan2023 · October 10, 2023, 6:24pm

Please send me Beta version

vknow360 · October 11, 2023, 12:49am

You already have.
The one I sent you for Tamil text recognition and it didn't work due to Tamil not supported.

ShanmugaNathan2023 · October 11, 2023, 3:46am

Oh, i think another new version with Tamil support also available.

vknow360 · October 11, 2023, 3:56am

Tamil is not supported unfortunately.

ShanmugaNathan2023 · October 11, 2023, 3:57am

Oh it's ok,

any new version update send me after released

vknow360 · October 26, 2023, 9:43am

ChangeLog Version 2

Rename extension to MlTBRek from SimpleRecognition
Some new blocks added and few blocks removed
Upgrade to ML Kit
Brings dynamic deps management and thus effectively reducing aix size to just 1.1mb
Major internal changes wherever there was room for improvement
Like support for Hindi and other Devanagari Script langs
Recognise blocks can accept Image component, File Path or Content Uri
Completely offline purchase verification

Ho_Brian · October 28, 2023, 8:13am

where can i download or purchase

ShanmugaNathan2023 · October 28, 2023, 8:24am

After sending 8$ to below link

DM @vknow360 to get the extension

Akram · February 23, 2024, 5:00pm

Hi, can you send me Demo APK.

vknow360 · May 4, 2024, 12:42pm

Demo Video:

vknow360 · May 4, 2024, 12:55pm

ChangeLog Version 3

Aix size reduced to 1.1 mb
Extension won't crash Companion now
Though none of its blocks will work.
No-conflict version to resolve deps conflict with my other ML Kit extensions like ImageLabelling and ScanKit

resuff · August 26, 2024, 5:22pm

hi @vknow360 Can you also add the languages: Korean, Chinese, and Japanese?

vknow360 · August 27, 2024, 12:58am

Yes, definitely.

resuff · August 28, 2024, 11:59am

I am eagerly awaiting your next update and am ready to purchase this extension. Please keep up the good work. You are the most dedicated and skilled extension developer I know