In a hurry? Download link for the program is here. Edit config_template.txt for directions on setup, it’s kind of tricky. Only runs on Windows right now. (Github source)
Why I wanted a “translate anything on the screen” button
I’m a retro gaming nut. I love consuming books, blogs, and podcasts about gaming history. The cherry on top is being able to experience the identical game, bit for bit, on original hardware. It’s like time traveling to the 80s.
Living in Japan means it’s quite hard to get my hands on certain things (good luck finding a local Speccy or Apple IIe for sale) but easy and cheap to score retro Japanese games.
Yahoo Auction is kind of the ebay of Japan. There are great deals around if you know how to search for ’em. I get a kick out of going through old random games, I have boxes and boxes of them. It’s a horrible hobby for someone living in a tiny apartment.
Example haul – I got everything in this picture for $25 US! Well, plus another $11 for shipping.
There is one obvious problem, however
It’s all in Japanese. Despite living here over fifteen years, my Japanese reading skills are not great. (don’t judge me!) I messed around with using Google Translate on my phone to help out, but that’s annoying and slow to try to use for games.
Why isn’t there a Google Translate for the PC?!
I tried a couple utilities out there that might have worked for at least emulator content on the desktop, but they all had problems. Font issues, weak OCR, and nothing built to work on an agnostic HDMI signal so I could do live translation while playing on real game consoles.
So I wrote something to do the job called UGT (Universal Game Translator) – you can download it near the bottom of this post if you want to try it.
UGT 0.62 released – now includes a hotkey for drag-rect selection and support for rendering Hindi https://t.co/0nIdLVmQ1B pic.twitter.com/6DdZfBAS87
— Seth A. Robinson (@rtsoft) April 12, 2020
Here’s what it does:
- Snaps a picture from the screen or HDMI signal, sends it to google to be analyzed for text in any language
- Studies the layout and decides which text is dialog and which bits should be translated “line by line”
- Overlays the frozen frame and translations over the gameplay
- Allows copy/pasting the translated or original language or looking up a kanji by clicking on it
- Can translate any language to any language without needing any local data as Google is doing all the work, can handle rendering Japanese, Chinese, Korean, etc. Different fonts are automatically used for different languages (configuration in font.txt)
- Controlled by hotkeys or a gamepad
- Can read the dialog out loud in either the original or translated language
- Can drag a rectangle to only translate a small area (Ctrl-F10 by default)
In the video above, you’ll notice some translated text is white and some is green. The green text means it is being treated as “dialog” using its weighting system to decide what is/isn’t dialog.
If a section isn’t determined to be dialog, “Line by line” is used. For example, options on a menu shouldn’t be translated all together (Run Attack Use Item), but little pieces separately like “Run”, “Attack”, “Use item” and overlaid exactly over the original positions. If translated as dialog, it would look and read very badly.
Here are how my physical cables/boxes are setup for “camera mode”. (Not required, desktop mode doesn’t need any of this, but I’ll talk about that later)
Happy with how merging two video signals worked with a Roland V-02HD on the PlayStep project, I used a similar method here too. I’m doing luma keying instead of chroma as I can’t really avoid green here. I modify the captured image slightly so the luma is high enough to not be transparent in the overlay. (of course the non-modified version is sent to Google)
This setup uses the windows camera interface to pull HDMI video (using Escapi by Jari Komppa) to create screenshots that it sends to Google. I’m using an Elgato Cam Link for the HDMI input.
Anyway, for 99.99999999% of people this is setup is overkill as they are probably just using an emulator on the same computer, which is why the default is “desktop mode” that just lets you use hotkeys (default is Ctrl-F12) to translate the active Window. It’s just like having Google Translate on your PC. You can also use Ctrl-F10 to drag a rectangle to translate, and using Ctrl-F12 after that will remember that rect position/size.
Here’s desktop mode in action, translating a JRPG being played on a PC Engine/TurboGrafx 16 via emulation. It shows how you can copy/paste the recognized text if want as well, useful for kanji study, or getting text read to you. You can click a kanji in the game to look it up as well.
Try it yourself
Before you download:
- Machine translation is not great (but getting better) – this is no way replaces the work of real translators
- You need to rename config_template.txt to config.txt and edit it
- You need to enter your Google Vision API key in the config.txt. This is a hassle but it’s how Google stops people from abusing their service
- Also, you’ll need to enable the Translation API
- Google charges money for using their services after you hit a certain limit. I’ve never actually had to pay anything, but be careful.
- This is not polished software and should be considered experimental meant for computer savvy users
- Privacy warning: Every time you translate you’re sending the image to google to analyze. This also could mean a lot of bandwidth is used, depending how many times you click the translate button. Ctrl-12 sends the active window only, Ctrl-11 translates your entire desktop.
- I got bad results with older consoles (NES, Sega Master System, SNES, Genesis), especially games that are only hiragana and no kanji. PC Engine, Saturn, Dreamcast, Neo-Geo, Playstation, etc worked better as they have sharper fonts with full kanji usually.
- Some game fonts work better than others
- The config.txt has a lot of options, each one is documented inside that file
- I’m hopeful that the OCR and translations will improve on Google’s end over time, the nice thing about this setup is the app doesn’t need to be updated to take advantage of those improvements or even additional languages that are later supported
After a translation is being displayed, you can hit ? to show additional options. Also, this is outdated, use the real app to see the latest.
Misc videos of features
Released Universal Game Translator V0.64 : now by default the right joystick button will trigger translations of the active window while nicely sharing the gamepad, don't have to touch the keyboard at all. Here's me playing a PS1 game via Retroarch. https://t.co/0nIdLVEqT9 pic.twitter.com/dCoolo8AoP
— Seth A. Robinson (@rtsoft) December 2, 2020
Added a "Push E to export to HTML" feature in UGT 0.65, helps me with Japanese study because now I can use the excellent chrome extension rikaichan/rikaikun on game dialog. Here's a crappily made video using FFXIII (PS3) as an example pic.twitter.com/e4gMNcTMef
— Seth A. Robinson (@rtsoft) February 5, 2021
Latest changes
10/31/2021 – V0.72 Beta
This release is bugfixes and new features to support using UGT in tandem with other translation software that work with clipboard data.
- FEAT: Can now disable translations completely (useful if you only want the OCR features) – set the active language to “00”. Config text file has an example showing how to do it
- FEAT: Added “Invisible mode (no overlay)” checkbox to the in-app options, if checked, UGT won’t actually overlay anything over the game. (it will look like it’s not doing anything, but as long as you’ve selected to put the text on the clipboard in the config.txt, this should work for people who are using another app to view the pre or post translations)
- BUGFIX: Export to html handles line-by-line correctly
- When copying things to clipboard, no longer includes the extra whitespace or last CR. Hm, or did we want the last CR? Oh well, let’s try this (jotumn)
- BUGFIX: Fixed freeze/crash that happened when Google processes text as upside-down (Meerkov)
- Added deepl_api_url config.txt setting, allows you to switch to the paid URL if needed. Previously it just would give a wrong URL error if you used the paid version, oops. (RandomTemere)
- Pre-translated text blocks are now colored similar to post-translated text (ie, green for dialog), was kind of confusing that they weren’t before.
11/01/2021 – V0.73 Beta
- BUGFIX: UGT screen shouldn’t be able to end up off the screen in an unusable position. Sometimes it takes two clicks to fix so it’s still slightly sketch though (Cloudstrifeff7)
- Now adding spaces in “dialog” mode text at a CR even when Google thinks it’s a continuation of a word, Google seems to be wrong a lot, so hopefully this is overall better. (no change for asian languages) (Cloudstrifeff7)
- BUGFIX: Alt-tabbing and opening UGT’s main menu no longer causes it to forget the last custom rect scan area set (Cloudstrifeff7)
11/07/2021 – V0.74 Beta
- BUGFIX: Fixed ugly bug with the hotkey system creating non-functional duplicates, not sure if it broke anything big but it can’t be good
- BUGFIX: Changed timing so it doesn’t sometimes cause weird laggy behavior in Windows 11, probably helps with earlier versions too
- Now gives a nice message if a hotkey can’t be registered with instructions on why and how to fix it (Cloudstrifeff7)
(Older history moved here, was getting outrageously long)
Download
NOTE FOR UPGRADING: It’s recommended to start with the config_template.txt again, just copy over your google API key and rename it config.txt again.
Download Universal Game Translator for Windows (64-bit) (Codesigned by Robinson Technologies)
Get an error about DXINPUT_1.dll missing? Please install The Microsoft DirectX® End-User Runtime
This is an open source project on Github
Conclusion and the future
Some possible upgrades:
- A built in Kanji lookup also might be nice, Jim Breen’s dictionary data could work for this.
- My first tests used Tesseract to do the OCR locally, but without additional dataset training it appeared to not work so hot out of the box compared to results from Google’s Cloud Vision. (They use a modified Tesseract? Not sure) It might be a nice option for those who want to cut down on bandwidth usage or reliance on Google. Although the translations themselves would still be an issue…
I like the idea of old untranslated games being playable in any language, in fact, I went looking for famous non-Japanese games that have never had an English translation and really had a hard time finding any, especially on console. If anyone knows of any I could test with, please let me know.
Also, even though my needs focus on Japanese->English, keep in mind this also works to translate English (or 36 other languages that Google supports OCR with) to over 100 target languages.
Test showing English being translated to many other languages in an awesome game called Growtopia
Incredibly wonderful work, thank you for sharing it with the world. I wonder if you were aware of an unclaimed bounty that could be relevant?
https://www.bountysource.com/issues/52185180-proposal-adding-ocr-and-translation-button-to-allow-playing-games-from-any-language
Also, one of the first things that popped up in my mind when reading over your post was the text-only annotated translation of Mizzurna Falls, a late-period Playsation release, available at https://projectmizzurna.tumblr.com/ . It would be interesting to know how and if OCR / computer-vision&translation could assist or further these kinds of nearly completed but stalled fan translation projects.
Thanks again for your amazing work.
This is something I’ve been hoping for since Google Translate was a thing. Thank you so much, and I hope you continue work on it! This feels like the first step in a seriously big deal.
I’m having issues where the text is being pulled from the window, but no translation appears (desktop mode). I can copy the original text and paste in to Translate though.
Hey Dan, can you check for a log.txt file in the same directory as the .exe? It might show an error that happened. Also, an “error.txt” file might exist, if so, it will show the error that Google is giving if it refused to translate something. Strange it would do the OCR but not the translation. Feel free to send the files to me at seth at rtsoft.com to check out as well.
Hi, amazing invention! I’m having the same issue as Dan Z above. I don’t see anything marked as an error on log.txt, and there’s nothing new on error.txt, but I’d be happy to send them to that address too. Also, not sure if this is relevant, but sometimes after pressing Control + F12 I get like 8-10 messages saying “Target language is Japanese” really fast.
Hi Maxwell, feel free to also contact me by email, I’ll fix the issue if I can recreate it.
Pressing the # 2 on your keyboard is a shortcut for Japanese by default, not sure why Ctrl-12 would cause the app to think 2 was hit, strange. Is the keyboard or Windows Keyboard layout non-US by any chance? If so, you might try editing the config.txt file and changing Ctrl-F12 to a different hotkey. It should say “Analyzing” when it’s hit.
If the target language is the same as the detected language in a block of text it won’t actually do any translation, maybe that’s happening? Press 1 to change the target language back to English.
For a test, I downloaded the zip on a different machine but it worked here. (I did rename config_template.txt to config.txt and set my google API key, nothing else should be required for it to work).
I’ve been having the same issue as Dan; UGT will OCR my current screen but not translate. Looks like this: https://i.imgur.com/TOCgDDm.png
No error.txt is present in the directory, and my novice eyes don’t see anything in the log.txt that seems relevant, but you can take a look here: https://pastebin.com/aftZi04q
Really promising tool, thanks!
Oh, one more thing, if you look in the directory for a “temp.jpg” and view the image, that is the last image sent to Google, might be useful to make sure it’s sending what you think.
Hey guys, I might have guessed the problem. I think the Cloud Language API has to be enabled similar to the Cloud Vision API.
Can you check here? https://console.cloud.google.com/apis/api/translate.googleapis.com
On mine, if I click Overview, it shows “Activation status: Enabled”. There may be a button you need to click to enable it. Under credentials, the API key listed is the same as the one for my Cloud Vision API. (I think Google does that automatically, I didn’t set it or anything)
I’m going to update the app soon to detect this issue and give a clear message about it. The “error.txt” thing isn’t working for this error currently.
Thank you so much Seth, that was exactly it. I had to enable the Translation API and then add it to my key under credentials. And now it works!! Amazing!
Yup, that did it for me too! Feel free to ignore the log.txt I just sent you, I should have check the later replies.
Just wanted to confirm that the issue was solved for me too!
One feature I think would be cool, if it’s possible, is the ability to keep the translated screenshots in a folder. I’m pressing Print Screen frantically to save all this good stuff.
Thanks for the updates. I uploaded a new version with some tweaks, same URL as before. (will say 0.51 instead of 0.50 on title screen).
Maxwell, I added an S to screenshot option. (It saves as screenshot_0001.jpg, screenshot_0002.jpg, etc) Should probably change to save to png later, but this only took a few minutes so good enough for now I figure.
Congratulations on the excellent work
– OCR detection fails on poor fonts
I have a suggestion as to the problem of poor results with old consoles (at least in desktop mode and for Western characters)
I remembered a process I’ve used in the past with a program that extracts subtitles from DVD movies known as SubRip
The process consisted of OCR detection, but you should type the letter found (once each time a different character), making the program, by comparison, detect all the rest
This worked very well for subtitles where the texts were very bad in the movies and the same case fits perfectly in old games, because usually the source of the texts is the same during the whole game
Why not include this feature in the UGT?
It would have a small work at the beginning of the game, so the program would set up a kind of table where it would “learn” which letter it is and theoretically would work throughout the game without detection and translation errors
I just do not know how I could help for Eastern characters
PS: Sorry for some typos, I’m Brazilian and I used google translate to post this message, original text below
Parabéns pelo excelente trabalho
– A detecção de OCR falha em fontes pobres
Tenho uma sugestão quanto ao problema de maus resultados com consoles antigos (pelo menos no modo desktop e para caracteres ocidentais)
Lembrei de um processo que já usei no passado com um programa que extraia legendas de filmes em DVD conhecido como SubRip
O processo consistia na detecção de OCR, mas você deveria digitar a letra encontrada (uma vez a cada caracter diferente), fazendo o programa, por comparação, detectar todo o resto
Isso funcionava muito bem para as legendas onde os caracteres eram muito ruins nos filmes e o mesmo caso se encaixa perfeitamente em jogos antigos, porque normalmente a fonte dos textos é a mesma durante o jogo inteiro
Por que não incluir essa funcionalidade no UGT?
Teria um pequeno trabalho no começo do jogo, assim o programa montaria uma especie de tabela onde ele “aprenderia” que letra é aquela e teoricamente funcionaria por todo o jogo sem erros de detecção e tradução
Só não sei como poderia ajudar para caracteres orientais
PS: Desculpe por algum erro de digitação, sou brasileiro e usei o google tradutor para postar esta mensagem, texto original abaixo
Like this
https://www.mesen.ca/docs/debugging/texthooker.html
I’m using desktop mode on a laptop, and any time I use ctrl +12 or +11, I get an image back that is much too big for the active window I’m using, and it cuts off the lower right half of the image by a good deal. Ends up looking like so:
https://imgur.com/a/3K1sh2g . The original window is the second image in the link.
I’m having an issue where it isn’t capturing the entire screen/window.
Looking at the log file it looks like the program is setting the video mode to 1024 x 768 instead of 1920 x 1080
https://i.imgur.com/ooUQtXS.png
Any clue how I might be able to fix this?
Other than that it’s been working great for me, thanks!
Hey guys, sorry for the slow replies, the anti-spam filter has been catching comments until I manually un-spam them.
Ramzero: I think Google DOES have a way to “train” the dataset so in theory this is possible now. Wonder if anybody has messed with that?
Mark: Hmm, yeah I can see the scale is off, like it’s zooming in or something. Do you any custom scaling options (like 150% scale so fonts are bigger) on your desktop by any chance? Also, if you press S so it takes a screenshot, is the screenshot cutoff also or it’s correct?
Harvey – In desktop mode it’s normal for the app to start in 1024X768, as soon as you do a “window scan” or “desktop scan” it should resize itself to grab (and overlay) the correct data. The custom resolutions are ignored in desktop mode, it should auto-resize as needed – I wonder if it’s the same problem as Mark had above.
I tried turning my custom scaling off and it works perfectly now, thanks!
All machine translation is HORRIBLE – this is no way replaces the work of real translators
not agree with this 1 because official is more suck translating than machine, a lot of them instead of translating the dialog they make their own dialog.
i hope i can get voice translate too because i getting feed up enough hearing missmatched translate from official translator game.
Hi, i have a problem with a game in fullscreen. When i scan, everything works perfectly but when i hit space for resume playing, my game minimize and i’m back on my desktop. Can anyone help me with that ?
Everytime I open UGT.exe, it opens up in my task manager for a few seconds then closes. Any solutions?
I tried to run compatibility under other versions, also tried to run as admin: no go. Any advice?
same here. black splash screen is appear and after 2 sec, closes windows.
I have put in API key,
i enabled translation api and cloud translation api
Hmm, Chloe and James – is there a log.txt file in the directory? Near the end, maybe it has some error message that would give us an idea of why it shutdown?
Valid key names:
Reading config.txt
Registered hotkey hotkey_to_scan_whole_desktop to Control,F11
Registered hotkey hotkey_to_scan_active_window to Control,F12
Registered hotkey hotkey_to_scan_draggable_area to Control,Shift,F11
Setting native video mode to 1024, 768 – Fullscreen: 0 Aspect Ratio: 0.00
Got WM_ACTIVATEAPP (1)
Setting size for GUI
Window is already 1024, 768
App got focus
Initial window pos is 448, 156
Initting Universal Game Translator 0.53 Beta by Seth A. Robinson (www.rtsoft.com)
GL Version = 4.6.0 NVIDIA 436.02
GL Vendor = NVIDIA Corporation
GL Renderer = GeForce RTX 2060 SUPER/PCIe/SSE2
Log.txt just texted this
wait.. Is this required api key right?
https://imgur.com/a/NWJqgJ6
I dont found any Cloud Vision API key.
I checked working other computer win10 1809. As same config.txt file.
My desktop is latest win10 and still not working.
Hmm. Even if the key was wrong or missing, it shouldn’t crash. (It will show a nice error message if the key isn’t accepted)
It looks like the app is failing to initialize either OpenGL or the audio system.
Is there a valid sound device on your system?
I’ve tested with a GeForce 1080 as well as a GeForce 2080 RTX so I think the GeForce RTX 2060 should be ok.
If nothing works drop me an email at seth at rtsoft.com and I might be able to do a special debug build to isolate the problem.
I think related audio system. Because i using soundfx system for enhance windows audio. I will test it.
However, it has never affected the behavior of other programs. It seems to be a problem that needs to be fixed.
I deleted my soundfx system from my windows and restart, still not working UGT. Sadly
Laptop is still working fine but desktop loads and then closes right away. Here’s my current log.txt:
Valid key names:
Reading config.txt
Registered hotkey hotkey_to_scan_whole_desktop to Control,F11
Registered hotkey hotkey_to_scan_active_window to Control,F12
Registered hotkey hotkey_to_scan_draggable_area to Control,Shift,F11
Setting native video mode to 1024, 768 – Fullscreen: 0 Aspect Ratio: 0.00
Got WM_ACTIVATEAPP (1)
Setting size for GUI
Window is already 1024, 768
App got focus
Initial window pos is 448, 156
Initting Universal Game Translator 0.53 Beta by Seth A. Robinson (www.rtsoft.com)
GL Version = 4.6.0 NVIDIA 436.15
GL Vendor = NVIDIA Corporation
GL Renderer = GeForce RTX 2070/PCIe/SSE2
Hey Nestor and others, please download the file again, I’ve updated it to V0.54 which should fix the crash on startup problem. Thanks to Chloe for testing this via email earlier today to verify it worked.
Can confirm, works again for me. Thank you Seth!
What a great application, Seth! Any plans to add logging of the source+translations for the PC/desktop mode? I’d throw in on that if you were to consider adding such a feature. Do you have a patreon?
The big barrier to that feature, in my mind, would be the persistence of text on each screen. Would need some way of throwing out duplicates when writing to file, I’d imagine. Or perhaps just maintain an in-memory expanding list of translations and then provide a button that dumps it to file.
Regardless, I came here to express my admiration and gratitude for this work.
Thanks Mike. Don’t have a patreon, but thanks for asking.
Thinking about logging – hmm. Unfortunately it’s pretty shaky as it is for my system to determine what is menu options and what is dialog (colored green) – it tends to make a lot of mistakes which would confuse logging. What might work is something like you can drag-out a rectangle to specify “log all text that is written in this area” and perhaps that would work for certain kinds of games, but you’d have to re-draw the rect if it changed, like if you went into a shop and the dialog box was a different size.
Ignoring already posted dialog would be a challenge as you mentioned but should be possible in theory. Hrm.
I am having issues with it working for me, I don’t know what I am doing wrong to the best of my knowledge I have done everything that was listed above in this. Could you help me?
Hi, thanks for adding screenshot support a while back! Desktop mode has been working great for me. Unfortunately I haven’t had any luck with camera mode. Both of my capture cards give me a “Device incorrect or in use” error. I’ve made sure the card’s software is closed and there are no related processes running in the background. The log file says:
Detected 2 camera input devices. We’ll use device 1 (AVerMedia C875 Capture) (set input_camera_device_id in config.txt to change)
Error with camera capture
Device 0 is my webcam, which just produces a black screen with no errors. My other capture card is an Elgato HD60 and gets the same error as the AverMedia card. What could be causing this?
Maxwell – Hmm, I’ve tested with an “HD60 Pro” (as it shows up in the “Game Capture HD” software it comes with), maybe there is a problem with the non-pro version. Unlike the desktop version, the config.txt screen size is very important – the default 1920X1024 setting might be not the actual resolution of the camera? Maybe it’s in 720p mode? (set to 1280 X 720). In theory it should scale the image as needed but.. worth a try. When setting the device in the config.txt, keep in mind 0 would actually be the first device.
I tried setting the game’s exact resolution on config.txt (in this case it’s 720×480, confirmed by recording a small clip and looking at the properties) and still no luck. I noticed something else: when using the AverMedia capture card, log.txt says “Detected 2 camera input devices” and includes the name of the card, but when using the Elgato HD60, it only detects 1 input (my webcam). So apparently it’s not picking up my Elgato at all?
When I start the translation nothing appears. I have to spam D or L hotkeys to get the translation to appear.
Not sure if i may have messed something on my end or is this normal?
It should immediately show the translation unless the option “Hide overlay text until cursor is moved” is checked (this is one of the options that show up right after starting the app, in desktop mode) – so make sure that’s not checked. Slow internet could also cause delays but you should definitely not have to spam keys – each time you hit D or L it is asking Google to translate the text again (and killing the current request), so that shouldn’t be necessary. The whole translation process should take only a second or two.
so im trying to use program however nothing is happening. when i hit my screenshot. i made sure the apis you mentioned were enabled. still nothing.
seeing a smartcurl error nothing happened error in the log
Scanning full desktop
Doing capture…
SmartCURL – Error, seemed like nothing happened.
kind of at a loss. Any ideas?
Hi Daniel, hmm, have not seen this error before. It appears that the CURL library is instantly returning as if it was done, yet not reporting any error. Make sure the file curl-ca-bundle.crt exists in the directory. Maybe make sure a firewall/etc isn’t blocking it. (although if that was the case, I’d expect to see a clear error there)
If you email me at seth at rtsoft.com I could possibly make you a special debug version with more error checking to get to the bottom of it. It might be it can’t use the network at all for some reason, I don’t think it’s even getting to where it can talk to Google Cloud.
on my games ive been using the google translate app on my phone, through my camera but its a pain. I was wondering how hard itd be to do something like that, where it treats your desktop as the camera on a phone, and just translates stuff at its own speed automatically, overlaying whatever is on your screen, without introducing input lag for whatever youre playing? jw
Keeps asking me to rename the “Config_example.txt and application will not progress even after I’ve done so. What am I missing here?
steven: Hmm. If config.txt exists in the same directory, it shouldn’t start up with the “Rename config_example.txt” message near the bottom of the screen. Make sure there isn’t an errant space or character in the filename anywhere, maybe try a different directory altogether in case the file permissions got screwed up and it can’t read the file for some reason. (running UGT.exe as admin might help in that case as well, but shouldn’t be necessary)
I was hoping someone can help me? I think I’ve setup the google translate api stuff right, but I’ve pasted it into my txt file and I get an error API key not valid. Please pass a valid API key. My config.txt api section looks like this –
;Note: Don’t share your google API key!
google_api_key|??????????
;Set the mode to work in.
All the ??? are my api key. What am I doing wrong?
Ignore my question earlier lol I put my api key in but the program was still open so once I closed UGT and reopened it it worked great – Thanks for creating this it’s amazing!
Glad to hear it’s working for ya John. I wasn’t able to get it working for Daniel (so far), but I’ve put the source code on Github today – so there is a chance a fellow programmer will have the same issue and be able to debug it and submit a fix that will help others. I also packaged up 0.61 with some minor changes like additional error checking and a new audio system. (FMOD was fine, but switching to Audiere is better for open source projects)
Amazingly useful piece of software, many kudos for the work you’ve put into this. Labor of love or not, it’s much obliged by many of whom are just as enthralled into Japanese cultural, amongst many others I imagine.
Curious if you have any plans on increasing compatibility with tategaki format dialog at some point as well? Mostly just enabling an exception in cases of vertical interpretations to expand/reform overlay text borders out of uniform when translation is parsed. It still gives partial translations in most vertical style formats but just gets dumped into piles of words in narrow text boxs. lol
Not TOO big of a deal, since luckily not many of the works I’m interested in dabbling into are inherently of tategaki format, but one particular VN i’ve longed to finally be able to read,
Kajiri Kamui Kagura, falls into this category. Though since you’ve left the project open source, I may just consider forking, and shooting a pull request if i come up with something on it. :p I don’t have a ton of time as of late, but when I get a bit to mess around with, I’d love to try and contribute a bit to this.
Again Cheers on the great work. This Project is inspiring honest.
Chris – thanks for the feedback. Would love to support vertical writing properly. Haven’t actually run into it with the games I’ve been playing but I’m sure it’s going to come along at some point and annoy me enough to add support. :)
In any case, if you do get around to looking at the source and maybe submitting additions I’d definitely work with you on getting it integrated/accepted on github.
In fact, for some time now I was wondering … but why on earth can’t you somehow use Google Translator to automatically translate games? It is true that automatic translations are not very precise but it is also true that they can be modified, perhaps manually where needed … NICE WORK MATE.
Hey, Just wanna say Thank you! SO SO MUCH. Using this I was finally able to make it through Ys V on PS2. it’s been my white whale of games I want to play but can’t understand and this tool did a wonderful job helping me know where to go or what I needed to find. Seriously can’t thank you enough.
If I may make a suggestion…. Could there be a way to map the translate active window hotkey to buttons on my USB controller when using emulators to trigger the translation window rather than having to hit my take my hands off the controller?
Sorry if this is a double post.
Thank you so much! With this I was able to finally get through Ys V on ps2. If I may make a suggestion for desktop mode could we somehow map it to a button combo on a USB controller rather than Keyboard only? that way I wouldnt have to put my controller down to translate active window.
Seriously. Thank you so much.
Looks like Google has switched to charging $45/hour or $80/2m characters of text for API access.
Am I missing something, or did this suddenly become an expensive way to play games?
do you know if there is some way i can translate a old outdated graphics game on PC that is chinese?some text in-game were big enough and got translated, but most of the chinese letter shows in game is quite small, and i was not able to get it translated with this program. thanks for answering
I might need some help, been trying to set it up to play emulators but I haven’t been successful. Any help?
Hi developer you have done a great work here my friend does not understand English but only punjabi but punjabi is unable to render and shows boxes. Is there anyting that can be done about that, like change the font??
Question, this seems to be working FOR THE MOST PART, but, no matter what I try it will only capture the upper left portion of my screen at an EXTREMELY zoomed in segment
Zak> I agree that would be useful. I don’t think it’s possible to share control with a game on the same controller (via XInput or DirectInput – has anybody ever seen that done?) – perhaps it could work with a second USB controller or something else though.
Anonymous> Hmm, I haven’t yet been hit with any charges, but I did get a notice that my “free year” was up a month or two ago. I set an alarm to email me when it hits $5 to be safe. You can do that from the Google Cloud Platform console by choosing “Billing”, then “Budgets & Alert” and then “Create Budget”. So far I still owe $0 but everybody should be careful just in case.
fairylander> Sorry, super small text gives me bad results too.
Gunwant Bhambra> I added support in V0.63 for Punjabi rendering (can hit [ and ] to cycle to that language)
CP> Hmm. If you check display properties in Windows 10, it might fix it to set your “scale” to 100% if it’s set to something other than that.
Seth> Any plans on supporting other auth types besides the API key? The more advanced translation options (V3 and by extension autoML) require a service account for the software to use.
I was also curious about how the two systems were interacting with one other and didn’t see to much in github (though I didn’t actually open the source files to dig around)
Hello! I have been playing with this for a while now. I am getting the following in error.txt:
“Error 400 (Bad Request)!!1 Your client has issued a malformed or illegal request. That’s all we know.”
I have entered my API key in various formats to try and resolve this. I don’t see what else it could be on my end. It seems it will accept anything as long as BEGIN/END PRIVATE KEY exist somewhere in the entered string. I only get a bad API Key error when I remove these prefix/suffix.
Any ideas what may be going wrong?
Jason: I would definitely add support for V3 communication if it meant better translations – my understanding that using AutoML for say, OCR of games would require work though, a training dataset and such. If anybody knows or has such a thing made for retro games I’d love to try it. Like, could a set designed for NES level Japanese kana work perfectly? Different sets made for certain game types? Without that, I don’t think there is any advantage in using the v3 API though, correct me if I’m wrong.
Luis: Hmm. Your cloud API key shouldn’t need any BEGIN/END stuff, I think maybe you’re using a service key instead of a Cloud API Key. A cloud API key should look like this: https://prnt.sc/s5l9du
You know, I think Google changed their docs and removed the link to make the API key from the help page I linked in the .txt file. It looks like it can still be made though, under “Credentials”, choose “+Create Credentials” and then choose API key. See pic: https://prnt.sc/s5lc0j
Hmm, maybe I really do need to support service keys… For now, I’ve updated the config_template.txt file inline instructions with better info.
Seth, thanks for the help! Very easy to fix.
@Seth
Yea there isn’t really any benefit to the new auth besides not needing to edit a config file to put in the API key (since I believe it uses an actual cert file).
From what I was reading on building an AutoML lib (or just basic vs advanced) it should let you have it learn from specific phrases you enter so some game terminology would probably come across making more sense.
You technically could have different AutoML libs for different game types (like if you wanted one so the translation came across more formal for medieval / fantasy games, and another with a lot of slang for a GTA style game)
Big problem being I’m pretty sure you’d have to train them separately, but might be worth for some of the more avid gamers.
(also I’m 100% not a programmer aside from slight edits to JSON files for azure templates and powershell scripts, so I have no idea how hard getting the new auth setup would be)
Link to the comparison page: https://cloud.google.com/translate/docs/editions
it can’t show TH/thai font how to fix this
I can’t thank you enough for your work. I beat Sakura Taisen on PS2 flawlessly, understanding most of it. It was awesome.
I have a suggestion, I don’t know if it is possible but, could you implement a live translation system ? same as google translate when the smartphone constantly scan the picture and replace the text/kanjis in live (no need to push keys to translate, it’s transaling all the time)
I hope you see what I mean ^^
The software works well, ocr is more accurate than other software, if there is an extra copy of the translated text, it is more wonderful, I will not need to go to google translate to translate it again. Google translate is a little bad at translating it, it doesn’t tell the line of the sentence.
Thank the author very much
Hey, I think this project is really cool, I’ve been thinking myself in this aproach for some time. I haven’t tested it yet but I have a question/suggestion. Are custom glossaries supported? That way you could add more accurate translations to each game and maybe some translators would be more interested in translating games seeing an easier approach, more similar to making movies/shows subtitles or mangas translations, since the only thing they would need would be the script transcripted and organized to put the translations in.
You paid only $25 for ALL those games???
DAMN, son! I haven’t seen even THE BIGGEST ‘game lots’ have *that much* here on eBay (esp. for such a low price) :o
Looks like there’s a bug when the UI/window to be translated is located on a display using negative coordinates, app locks up (nothing logged).
I can’t think of an easy way to reproduce this, other than possibly changing the layout or which display is primary in Windows.
Anonymous – Hmm, I do use a dual-monitor system and my left monitor is in negative coords. (My right is primary) It does work properly for me, maybe there is something else happening as well. You might check display settings and see if “Scale and layout” and see if it’s set to something other than 100%.
Seth – Was at 100% on everything, fired up a debugger and… turns out it is that problem… but not in UGT, rather in NahimicOSD :I
Thanks for the reply.
i downloaded it but how do i apply it to a game ?? im trying to play gakuen handsome wich is written in full kanji D:
pls help
this is so awesome! im really amazed. well done.
im looking for an overlay for LoL since many different language players type in chat.
Wow, this could be lifechanging in playing some doujin games…Any chance that this could be also used in conjunction with/via other APIs like Ztranslate API, yandex or I don’t know, instead of Google’s that is a paid service?
This is such an amazing program. Thanks. I have a request which I hope you will work on. Please make it work with live real-time translation like on the google translate app on phone. you can use the camera to point wherever and it will translate in real time on the screen. That would make it perfect.
I’d prefer using DeepL over google translate but this is already amazing enough that translation accuracy would be less of a priority.. Keep up the amazing work!
Have you considered putting up a patreon(With how much use I’ve gotten outa this I wouldn’t mind tipping you)? I’ve been using your app since the 0.5 releases and its for sure my go to MTL.
(I will still hold out hope for service key support or integration with other cloud translation platforms in the future)
Keep up the good work.
Thanks for the kind words, no need for tips, just happy somebody is getting use out of it!
As for as supporting something other than Google for OCR/translation/Text to speech, Google’s stuff is meeting my needs (for now?) so I’m not really pushed to add any other apis for now. If any programmers want to add it/them and submit it as a git pull request please drop me a line, would be happy to test it and get it merged.
Is there anyway to make this continue to actively translate a certain area on the screen as new text appears automatically?
Hi Marcus, unfortunately there isn’t. It would be possible to write some kind of “if X% of pixels have changed, initiate a capture” but this would break with swirling backgrounds and things and end up sending too much data to Google, hrm.
what about initiating a translation in the same spot at regular intervals say after 5-10 seconds to try to accomplish a similar effect if what you suggested is likely to cause problems?
Pingback: Tokimeki Memorial Drama Series Vol. 1: Nijiiro no Seishun (PlayStation, 1997) – Pixel Hunted
Thank you for making this, this is great.
This works perfectly on my 1440p monitor, but when I use it on my 4k monitor, the capture image is a zoomed in image of the top-left quarter of my screen. Looking through the config for options to help this, but can’t find anything.
Let me know if you have a fix!
whats the deal with the google API stuff? Is it possible to use your program without giving google my card info and signing up for this free trial bullshit?
I would really like to use your “free” program but it seems google is gatekeeping their “free” translation service for some reason i dont get it
Maggie: Google doesn’t want to give the world unlimited free access to their cloud based supercomputers and datasets that give state of the art OCR/translation/TTS services.
Signing up allows them to restrict individual users to a certain amount of API access per month. The credit card I assume is to keep bots from creating a million accounts to abuse the service with.
Personally I’ve never had to spend a dime as I haven’t gone over the free limits in place. You can set an alert if your charges ever hit $1 for peace of mind. It’s doubtful any local or free solution will ever be able to compete with what Google can do so if you want the best, you gotta jump through their hoops. It’s not a scam or anything.
Enabled both translation api and put the api key into the config.txt file
When I try opening the app it give 2 errors,
“(1) VCRUNTIME140.dll
(2) XINPUT1_1.dll was not found. Reinstalling the program may fix this problem.”
After reinstalling I get the same error msg, do you have any idea whats wrong?
Dustin: Hrm, what OS are you using? I would think Windows 10 includes these so I assume you’re using Windows 7 or 8?
It can probably be fixed by installing the Microsoft Visual C++ 2015 Redistributable package here: https://www.microsoft.com/en-us/download/details.aspx?id=52685 and for XINPUT1_1.dll try installing the latest version of DirectX: https://support.microsoft.com/en-us/topic/how-to-install-the-latest-version-of-directx-d1f5ffa5-dae2-246c-91b1-ee1e973ed8c2
Seth,
I want to commend you on how great it is that you’re continuing to develop this tool. While I’m also drawn by the prospect of translating old games, I’m equal floored by its utility in helping translate books. For me, I’m particularly interested in foreign tabletop RPGs. If the previous conversation with Chris develops further, there are a lot of examples of Japanese vertical formatting in tabletop replay books (a number of which are available through bookwalker and mangaz). I look forward to developments!
Hi! Super excited to use this program. Jumped through all the Google hoops to get my API key.
Saved it the config as shown (X’s are to block out my key)
;Note: Don’t share your google API key!
google_api_key|premium-sum-XXXXXX-XXXXXXXXXXXX.json
But getting the same problem when I try to use the application:
” …cannot proceed because XINPUT1_1.dll was not found. Reinstalling the program may fix this problem.”
But I have the most current version of DirectX. Using Windows 10. Any idea how to fix this?
Can you provide XINPUT1_1.dll ???
Thanks so much. If this works I will gladly donate to you.
Highly Appreciated.
J
Karsing, ah, I think I see the problem. I’m using an older DirectX library that doesn’t come automatically with the latest DirectX (but should increase compatibility with older Windows versions?) – this can be fixed by installing “The Microsoft DirectX® End-User Runtime. (this won’t change your current DirectX, it just adds some older libraries that might not be there)
Please try installing it from here: http://www.microsoft.com/en-us/download/details.aspx?id=35
Awesome!!! That worked thank you! But am having difficulties with the formatting on how I enter the data into the config.txt.
Like could you please give me an example of how it should look when it’s about to be saved like for example:
;Note: Don’t share your google API key!
google_api_key|yourkeygoeshere
is this correct:
;Note: Don’t share your google API key!
google_api_key|premium-sum-XXXXXX-XXXXXXXXXXXX.json
or this?
;Note: Don’t share your google API key!
google_api_key|XXXXXX-XXXXXXXXXXXX
or this?
;Note: Don’t share your google API key!
google_api_key|XXXXXX-XXXXXXXXXXXX
X’s representing actual key alphanumerics of course.
I feel am close please help me set this up right, thanks so much.
Also now getting this error:
You need to rename config_example.txt to config.txt first. Use a text editor on it to set your google API key and read about other settings.
[ok]
I have done this already but it still is asking me to change it.
in the director the file is named:
config.txt
I solved the config.txt problem.
I renamed it to just config not config.txt and it finally loaded.
Okay so I think this formatting may have worked:
;Note: Don’t share your google API key!
google_api_key|C:\Users\XXXXX\XXX\premium-sum-XXXXXX-XXXXXXXXXXXX.json
But now if I Ctrl-F12 a window this is what keeps displaying at the bottom:
Error.txt Written:
Feel like I am so close… Please help!
I will def donate well to you. I am so excited to play fringe Japanese games. Thanks so much.
Sorry!!!! Finally figured it out.
I realized I had the wrong key.
Now working amazingly!!!
Sorry for the comment bombs.
Also where can I donate? Thanks
already install and it’s work well with japanese to English.
But when i try to translation from English to Thai ,The language was show in green word like a erro massage. sample [][][][][]X[]
How can i fix it. Thank you.
What an amazing little program this is, I started using it for some retro games but now I’m mostly using it for studying purposes and for reading manga, one thing that has always pissed me off is the fact that Google doesn’t offer image recognition/OCR for its translator on PC, only on mobile apps which really doesn’t make any sense!! PC matters too! Okay enough ranting thanks for creating this, is amazing and it helps a ton for studying/learning Kanji, a really great ally to have for such a monstrous challenge.
Also.. Remember if your free trial ends Google gives you for free each month a 1000 OCR requests/images, after that is $1.50 for every 1000 images you OCR.
Translation is the same, 500,000 characters for free each month, after that is $20 per million characters.
Maybe the author could look into integrating Microsoft’s services on the app as an alternative? They’re slightly cheaper, 5,000 OCR free per month and 2M characters free for translation, I don’t know how hard it would be though, I had previous experience with Google Cloud so it was easy for me, Microsoft.. not so much, you will have to do some research.
https://azure.microsoft.com/en-us/services/cognitive-services/translator/ and https://azure.microsoft.com/en-us/services/cognitive-services/computer-vision/
Also most of the time the translations can be worse than Google’s or way worse than DeepL but sometimes they can surprise you and be better than Google or get some stuff right that Google or DeepL couldn’t get right.
My god that google translate api uses some complicated interface for the settings. I have no clue how to limit it to stay free or set warnings at least to alert me if it hits the limits. I hope I don’t end up spending alot by accident somehow. Also are none of the other API’s any good? like say SYSTRAN.io or Yandex translate since those say they’re free.
Hey seth how would I run this on a macbook I looking to play the classic anime fighting games in Japanese for playstation any help would be greatly appreciated
hey how are you great advice thanks, is there any live voice in game translation?
Hello I’m new to this and I just got this software but I’m not sure what this “API key not valid, Please pass a valid API key” message is. I don’t know what an API key is and how do you put it in and all that.
This is fantastic – the setup guide was easy to follow for someone with passable understanding of windows applications and web API.
I’m interested to see how others are using the program to game, i.e what’s the optimal method of using the program?
I’m using it in a online card game (Duel Masters Play’s) which relies solely on point and click. As far as I can see the best method for using the program is to set the program to the window, translate with ctrl+F12 and use alt+tab to swap back to the game window.
Further is there anyway to support this project @Seth? Also TYVM
Hello,
I used to run an older version of UGT fine on my old windows 7 setup. However, since I upgraded to a new setup and windows 10, I seem to be unable to run it in camera mode. I’m using a magewell capture pro HDMI, which is the same capture card that I used on my old setup. The log relevant log lines are:
Detected 1 camera input devices. We’ll use device 0 (Video (00 Pro Capture HDMI)) (set input_camera_device_id in config.txt to change)
Error with camera capture
Desktop mode works fine.
Any ideas on how to solve this ?
Thanks!
Hey SprosK, hmm, strange. All my camera tests have been with Windows 10 so in theory it should work. You might try pressing R a few times (resync) and see if it makes a difference.
Alcad – You’re very welcome. I don’t have a patreon/etc but sharing info about the app on twitter/etc is always greatly appreciated!
Th3iyo – It’s kind of a hassle to setup, basically you have to jump through some Google hoops so we can use their cloudVision service. Check the config_template.txt file closely, there are instructions there.
Jimmy – no, there is no way of translating spoken dialog currently. I’ve been trying to think of a way to do this quick enough…
Bryan, sorry only Windows is supported. The source code is sitting on github though, so if a mac pro wants to help support OSX, well, that would rule.
Taya – Thai language support should work. Maybe the try latest version again? If not, edit fonts.txt, you can set a custom font to use with Thai display if needed.
Google Cloud is so terrible. I just spent an hour trying to make an account there for this stupid application, and it refused to allow me to because it didnt like either of my credit cards, my paypal account, or my debit card. At this point, what can you fucking do? I tried going to support repeatedly, but its impossible to contact anyone without a billing account ID, and I dont have one because google refuses to let me set one up.
So im just calling this software useless as it relies on the most terrible service ive ever dealt with.
your project is amazing
I am from Israel and many children here will be happy to use this
but after I tried this in my desktop the Hebrew is backwards
can you please add support to RTL languages
is there anyway to remove the series of repeated … or long lines I think it maybe be a repeated japanese character looks like a —– bunch of dashes like that repeated. DeepL translate API seems to go haywire anytime a game has pauses in text broken by repeated characters.
Marcus – Hmm, can you link to an example image that I can use to recreate the problem? I don’t think I’ve seen that on my end yet.
Here are some examples of translated and original text. Some of it is legible but it often ends up scrunched together or seems to maybe skip some words and just doesn’t make sense. https://i.imgur.com/i1CoJSl.png https://i.imgur.com/dYtVh1H.png https://i.imgur.com/kL8Q0mm.png https://i.imgur.com/LvoSR7c.png https://i.imgur.com/idxfzMs.png https://i.imgur.com/pLIjOFF.png
I tried to send an example but it seems to have disappeared so I will ask about a more pressing issue instead. I seem to have easily hit the google cloud vision limit of 1000 images. I’m actually at 4000 images but I’m only at about 150k/500k character limit for DeepL is there someway you could do this without the usage of google as it seems to be the bottleneck in my case after playing some new games for a little over a week. It also seems to send multiple request per translation which probably isn’t helping the google translation limit. I have to hold the button down on the gamepad for it to translate and I do notice I see the analyzing screen text scroll up in the screen multiple times. I’m not sure if this is caused by my gamepad setup somehow or if this is just how your program normally works.
Would google lens be a possible alternative for this (I’m told this is totally free) or can this work with just DeepL somehow? I think I will end up with $10-15 bills every month from google at this rate.
Marcus, sorry your post with the pics got caught in the spam filter, it’s visible now. Ah, yeah I see what you mean. The system doesn’t know what to think about the long lines separating words, that’s not standard Japanese, is this a specific game or game engine that displays this way? I think Google’s OCR is breaking it up into incorrect text blocks which is messing it up, no easy fix sadly.
About google cloud vision, this IS effectively API access to same engine google lens is using, they will not let us use it from a standalone app without the limited account stuff. However, you should NOT be seeing “Analyzing screen” multiple times or having to hold down a button, I think it’s probably sending multiple requests and wasting your bandwidth/API calls.
Are you using a Xbox 360 or Xbox One controller? That’s the only kind I’ve really tested with.
I’m getting a message saying the file “api-ms-win-shcore-scaling-l1-1-1.dll” is missing from my system, making UGT unable to run.
Any ideas on how to solve it? Thanks.
>>I’m getting a message saying the file “api-ms-win-shcore-scaling-l1-1-1.dll” is missing from my system, making UGT unable to run.
Hmm, I think the problem might be this is only included in Windows 8 and newer, it helps me handle screen scaling settings correctly. Are you running Windows 7? If so, you should upgrade, Windows 7 is quite old and no longer receives security updates I guess. If that’s not it, let me know and I’ll figure it out.
Thanks for the app, It was working correctly but after I did fresh re-install on windows everytime I launch an app I get “Error initializing the game. Did you unzip everything right?”
In the log it says “Error loading fonts.txt file”, if that helps and it also can’t find config.txt, but it doesn’t open when it is not in folder.
anon – well, two things come to mind – one is try installing the latest DirectX, it might add a .dll that is needed. You said it was a fresh Windows install, it could be there is something needed.
Second, it might not have been unzipped/unpacked right? You should drag the UGT folder from the zip onto your desktop, enter that folder and run UGT.exe, and it should show a message about renaming the config.txt file and close, but no error messages. Maybe try downloading 7-Zip and using that? https://www.7-zip.org/download.html
Fonts.txt is inside the UGT folder.
Hi Seth, thanks for reply and amazing software! I tried installing directx from here https://www.microsoft.com/en-us/download/confirmation.aspx?id=35 multiple times already. I used 7-zip, winrar and native windows archive unpacking tool, even copied a version of UGT from other pc, where it is working fine – all to no success. Font. txt is in folder. Here is the full log:
Valid key names:
Reading config.txt
Couldn’t find config.txt
Setting native video mode to 1024, 768 – Fullscreen: 0 Aspect Ratio: 0.00
Got WM_ACTIVATEAPP (1)
Setting size for GUI
Window is already 1024, 768
App got focus
Initial window pos is 448, 156
Initting PlayTrans: Universal Game Translator 0.74 Beta by Seth A. Robinson (www.rtsoft.com)
GL Version = 4.6.0 NVIDIA 516.59
GL Vendor = NVIDIA Corporation
GL Renderer = NVIDIA GeForce RTX 3070 Laptop GPU/PCIe/SSE2
Initialized GL defaults
GL depth buffer: 24 bit
Initialized Audio
Error loading fonts.txt file
App lost focus
Got WM_ACTIVATEAPP (1)
Entered foreground
Anon, hmm, I’m stumped.
I happened to be setting up a brand new Windows 11 computer today and I downloaded UGT from my site, dragged the folder to my desktop, double clicked the folder and then double clicked UGT.exe, and it worked ok. (Well, I got a XINPUT1_1.dll is missing error, installing Direct X fixed it)
What version of Windows are you using? Is there any possibility of a permissions problem in the folder? It really seems like it can’t locate or open font.txt and other data files, this might not be something I can fix on my end, very strange.
Some things to try:
1. Set folder permissions so you own the folder and make sure read/write is enable: https://www.easeus.com/file-recovery/you-donot-currently-have-permission-to-access-this-folder.html
2. Try it with anti-virus disabled? That’s a long shot but anti-virus could silently stop it from opening something.
3. Try running it as administrator. (right click the .exe and choose run as administrator) Shouldn’t be necessary, but if it does work, it shows it is a permissions problem
So I tried everything you mentioned: making sure that the folder is not read only, adding folder as an exclusion to windows security and running the .exe as administrator. All to no success. However, you post got me thinking on the right track and I decided to try moving the folder from Desktop to Program files(x86) and it actually started working! Same thing when I move it to my windows user folder. First time this happens to me that a program doesn’t boot properly when folder is on desktop. And It actually works perfectly from desktop on my other pc. The windows version is
Windows 11 Home
Version 21H2
OS build 22000.795
Experience Windows Feature Experience Pack 1000.22000.795.0
Actually, even though it does boot from Program Files(x86) It crashes when I try to run a translation. But it seems to be working ok when placed in my user folder.
Hey, I just wanted to say this translator app has been incredibly useful for games as well as untranslated manga. However, as Chris and Karsing mentioned a while ago, the formatting is slightly messy for text in the tategaki (vertical) format and I wanted to help fix this. I looked at the source code and was wondering if you could help me locate where which file contains the relevant code for formatting the text output in a text box. Additionally, I noticed the some files have .rttex and .rtfont extensions and I was hoping you could explain how to modify these.
HatSlapper – Hmm, one way would be to modify GameLogicComponent::ReadFromParagraph and notice that the rect is really skinny and flip it around so it renders more horizontally. (won’t match the shape of the text it’s on, but at least you could read it better). (Beats copy and pasting into another notepad or something)
To properly display the untranslated kanji overlay (less important but..) would be to modify FreeTypeManager::MeasureTextAndAddByLinesIntoDeque and FreeTypeManager::TextToSurface to accept a “vertical” rendering flag to actually compute and display everything vertically
.rttex format images are made with rtpack.exe. https://www.rtsoft.com/wiki/doku.php?id=proton:win_setup2 Proton apps can directly read jpg/png if enabled so it’s not really needed these days, I don’t remember if UGT has libjpg/libpng enabled.
That util also makes .rtfont files. The translated rendering in UGT doesn’t use rtfont though, it uses the FreeTypeManager class instead to render. (to temporary surfaces mostly as it’s kind of slow)
rtpack and its source are included as part of Proton SDK. https://github.com/SethRobinson/proton
I tried doing everything that the other anon did, but I don’t seem to be having any luck getting this to work so far. Moving to User folder and Program Files (x86), setting it all to no read-only, even allowing it through my firewall. The weird thing is, I’m not getting any error logs and I briefly noticed the ‘translating’ image before the translator crashed; which suggests the process is at least working until it gets a return reply. I do have the Vision API, the Translator API, and even a free Deepl API all enabled and active. I tried removing the Deepl API by only using the Google translation option, but it still doesn’t seem to be giving me anything useful. Would you happen to know what might be causing this?
Hello
Thanks for the app, helps a lot when you live in a country without knowing the language.
Could you consider a possibility of publishing 32bit build for devices not supporting 64bit Windows? Though I understand how low is userbase
At what point would google start to charge you for this? Is it a monthly allotment or at a certain point does it require payment to use this tool?
Hi Yuki, Google gives a fairly generous monthly allowance. I don’t think I’ve ever been charged. Also, just in case you missed it, I did talk about how to set it to email when you hit the limit here: https://github.com/SethRobinson/UGT/issues/43#issuecomment-1248756016
>Are you running Windows 7? If so, you should upgrade, Windows 7 is quite old and no longer receives security updates I guess. If that’s not it, let me know and I’ll figure it out.Are you running Windows 7? If so, you should upgrade, Windows 7 is quite old and no longer receives security updates I guess. If that’s not it, let me know and I’ll figure it out.
I’m getting the same api-ms-win-shcore-scaling-l1-1-1.dll error while loading the application on Windows 7. There’s quite a few of us out there that don’t want to upgrade. Is there any workaround for Win7 users?
R/
Hi, if i use only Deepl in the config line “translation_engine|deepl”, can i be charged by Google Vision ?
Or UGT use only my Deepl Free Account ?
Thanks
Hello,
I’m having a problem playing fullscreen on a TV with the Geforce GPU, the screen flashes and always shows the same screenshot, do you have any idea how to solve this?
Hrm, fullscreen is kind of hit or miss, does it work if the game/emulator is in a window? Sometimes true fullscreen won’t work, but “windowed borderless fullscreen” does. Another option may be to change the game/emulator renderer to different things. (OpenGL/Direct3D/Vulkan/DirectDraw etc) HDR enabled should be ok.