top | item 45364047

(no title)

cosmojg | 5 months ago

I must admit, one of my favorite recent-ish Android[1] features is that all text is made selectable in the app switcher using on-device OCR. Regardless of the app[2], you can just swipe up and start selecting text.

[1] ...at least on the Google Pixel.

[2] ...unless it's a banking app and it blocks permissions for screenshots and similar things.

discuss

order

crossroadsguy|5 months ago

Blocking screenshots for certain apps has been like "someone drowned in a lake -> block access to the lake".

The only thing it helps in is helping banks close the tickets when you inform them of a bug and they ask for screenshots and you tell them you can't because their app doesn't allow it, so "… closing this ticket since we received no further input from the customer. Please feel free to reply if you need anything else."

They never tell me to take a photo from another app and I never volunteer to do that because if they reply like this I know they are not going to work on the bug.

bart7782|5 months ago

Blocking screenshots also blocks screen recording and screen sharing. Which actually helps to increase security.

As someone with remote access to your phone will not be able to use banking apps. You can only see them when holding the device physically.

digianarchist|5 months ago

On iOS you can create a shortcut to push a screenshot through the built in OCR and copy to clipboard. You need to crop beforehand if you don’t want all the text on the screen.

https://imgur.com/a/NctIGsK

cryptonector|5 months ago

On recent iOS versions it just happens. You try to click on an image in the browser to save it and whoops! you're clicking on text in the image that iOS already OCRed for you. And the Photos app will let you search for OCRed text, and it OCRs _all_ the text without you having to lift a finger.

svobodovic|5 months ago

Yes, I just wanted to reply the same thing. It's a great feature for these use cases (albeit, I too would like to see more universal or friendlier approach to text-selectability in apps).

Additionally, the text copied in this manner can be instantly opened in Clipboard editor (at least on Google Pixel), and when selected again there, it offers even more contextual options, such as translate in one of your installed apps (like Deepl).

That way, you can translate the "non-selectable" text in a very few short taps.

pastage|5 months ago

OCR seems to be working on recent Android versions not only Google hardware.

jayknight|5 months ago

Yep, on my S22, I long-press home and can then circle or swipe text to copy, or translate if needed.

abustamam|5 months ago

> unless it's a banking app and it blocks permissions for screenshots and similar things.

Yeah those can fuck all the way off. I'm lucky I have two phones so I can take a photo of my screen and use it for OCR or whatever, but it's ridiculous I have to do that.

I understand that for security purposes they don't want to let you take a screenshot in case of a man in the middle or whatever, but let me risk it. Warn me or something, but let me do it.

71bw|5 months ago

Exactly the reason I still use LSPosed with the disable_flag_secure module on my device.

pjc50|5 months ago

This is also my new favorite Android feature. It also enables translation. It even works for non-left-to-right languages, e.g. vertically written Japanese. The only downside is its tendency to immediately search for whatever you've selected, dumping all sorts of nonsense into my search history.

I do like when an accessibility feature is a hammer one can use against web designers who've disabled other features. The next one I want is "zoom non-zoomable web pages and apps".

bapak|5 months ago

Same for iOS, just not immediately possible. In iOS the new screenshot UI makes it a little easier, before it would need at least 3 taps and a couple of seconds to make it selectable

al_borland|5 months ago

The OCR in iOS and macOS has been a game changer for me. It seems like such a small thing, but it changes how I work in a big way.

If someone is sharing a webpage, I don’t need to ask for the link anymore. Just take a screenshot and click it. I do this multiple times every day.

andai|5 months ago

This includes not just images, but text which is part of the app's UI, and not otherwise selectable, right? If so, that is pretty funny. Running advanced machine learning models to extract the data that we already have (but won't let the user access normally).

averageRoyalty|5 months ago

> unless it's a banking app and it blocks permissions for screenshots and similar things.

Can you not disable this? I just tested on stock iOS, and I can screenshot all of my banking apps.

jadbox|5 months ago

This is my favorite feature on Android next to sideloading.