Listener GUI Started

So with the code-context, the dictation in Listener is getting okay-ish. It's still pretty frustrating and error prone, but I can use it maybe 1/4 of the time (mostly for doc-strings). Part of the frustration is just that the language models are not yet well tuned for some commonly needed phrases that the tokeniser didn't generate for the code corpus, but a big part of it is that I don't yet have the correction/undo operations nor the navigation bits, so any mistake means editing by keyboard. The lack of a good contextual awareness/biasing model is also pretty big.

So, I've been working on getting the GUI built up for doing corrections. As of now, a dbus service runs in the background which is driving the interpreter, and IBus and delivering the partial and final transcriptions via signals to the front-end GUI. I've also got a "floating window" that shows the text as you speak, though currently you have to install some KWin config to get it to float over other windows (due to focus-stealing protections). I'm thinking a KDE plasmoid that runs in the panel might be a better approach.

The idea is that the DBus service will be reusable for other GUIs and will be the primary API used to communicate with the service, so e.g. a code editor plugin will pass context information through the DBus API, the GUI will use the API to update rules, send correction updates, etc. Up until this point, I've been using ad-hoc socket communication... which honestly was a lot easier to develop and control, but if the project is to become a general service for the Linux desktop I suppose I need to embrace the native RPC mechanism.

Side notes: I am finding pydantic useful, but definitely frustrated with it not playing well with regular properties. DBus in PySide isn't thrilling me, but it works once you fire up qdbusviewer and realise that you're listening for the wrong thing and you debug cryptic data-format issues. The "Qt tool window that floats over all other windows" thing took entirely too long to figure out was something blocking the effect (Kwin), rather than me "spelling" it incorrectly. Facebook just announced a transformer-and-audio based model that sounds a lot closer to what I'd like to work with, but I'll focus on getting my current implementation useful first before experimenting with swapping out the back-end.

Comments

  1. book epub

    book epub on 07/24/2020 10:23 a.m. #

    One Flew Over The Cuckoo'S Nest Book Citation Teaching And Learning Of Geography

  2. book epub

    book epub on 07/24/2020 10:23 a.m. #

    One Flew Over The Cuckoo'S Nest Book Citation Teaching And
    Learning Of Geography

  3. Kiagal

    Kiagal on 07/24/2020 4:40 p.m. #

    [url=http://advair250.com/]advair by mail[/url]

  4. Joegal

    Joegal on 07/25/2020 2:09 a.m. #

    [url=https://estrace2.com/]estrace gel[/url] [url=https://prazosin.us.com/]prazosin bph[/url]

  5. Wimgal

    Wimgal on 07/25/2020 2:29 p.m. #

    [url=http://hydrochlorothiazide2.com/]hydrochlorothiazide brand name australia[/url]

  6. Kimgal

    Kimgal on 07/25/2020 6:12 p.m. #

    [url=https://ampicillin24.com/]ampicillin 50[/url]

  7. Annagal

    Annagal on 07/26/2020 5:27 a.m. #

    [url=http://elimitepermethrin.com/]elimite price in india[/url] [url=http://lasixwtp.com/]lasix 500[/url] [url=http://anafranilmed.com/]buy anafranil south africa[/url]

  8. Lisagal

    Lisagal on 07/26/2020 7:08 a.m. #

    [url=https://lexaporo.com/]lexapro mexico[/url]

  9. Jackgal

    Jackgal on 07/26/2020 2:02 p.m. #

    [url=https://diclofenacg.com/]diclofenac capsules medicine[/url] [url=https://vardenafilxr.com/]vardenafil canadian pharmacy[/url]

  10. Janegal

    Janegal on 07/26/2020 2:16 p.m. #

    [url=https://lopressormetoprolol.com/]100 mg lopressor[/url]

  11. Janegal

    Janegal on 07/26/2020 5:08 p.m. #

    [url=https://advair2019.com/]advair 2019 coupon[/url]

  12. Janegal

    Janegal on 07/27/2020 9:16 a.m. #

    [url=https://hydrochlorothiazide2.com/]hydrochlorothiazide prescription coupon[/url]

  13. Janegal

    Janegal on 07/27/2020 2:52 p.m. #

    [url=https://diclofenacg.com/]diclofenac gel otc uk[/url]

  14. Kimgal

    Kimgal on 07/27/2020 6:51 p.m. #

    [url=https://advair250.com/]generic advair canada pharmacy[/url]

  15. Kimgal

    Kimgal on 07/27/2020 8:49 p.m. #

    [url=https://cleocing.com/]cleocin topical gel[/url]

  16. krimstailm

    krimstailm on 07/27/2020 10:53 p.m. #

    [url=https://extraint.ru/catalog/pristavnoj_stolik_helice]Диван Camin[/url] или [url=https://extraint.ru/catalog/bra_pimlico_chd_2153pn-wg]Комод Nin 51641[/url]

    https://extraint.ru/catalog/rakovina_garden_bandana

  17. Lisagal

    Lisagal on 07/28/2020 1:04 p.m. #

    [url=https://lopressormetoprolol.com/]lopressor 50 mg cost[/url]

  18. Lisagal

    Lisagal on 07/29/2020 9:58 a.m. #

    [url=https://motilium10mg.com/]where to buy motilium in canada[/url]

  19. Kimgal

    Kimgal on 07/29/2020 11:01 a.m. #

    [url=https://cleocing.com/]cleocin 150 cost[/url]

  20. Janegal

    Janegal on 07/29/2020 7:16 p.m. #

    [url=https://zoloft360.com/]zoloft 50 mg price in south africa[/url]

  21. inatailm

    inatailm on 07/29/2020 9:20 p.m. #

    [url=http://www.alkraft.ru/techno-doors]лючки металлические[/url] или [url=http://www.alkraft.ru/protivopozharnye-lyuki]металлические сантехнические люки[/url]

    http://www.alkraft.ru/production/inzhener

  22. Kimgal

    Kimgal on 07/29/2020 11:49 p.m. #

    [url=https://nolvadex10.com/]best nolvadex[/url]

  23. Computational Social Science Microsoft Research

    Computational Social Science Microsoft Research on 07/30/2020 1:14 a.m. #

    Literary Nonfiction Modern Education Logo

  24. Special School Vision Statements

    Special School Vision Statements on 07/30/2020 10:12 a.m. #

    Who Has Always Been Called The Morning Star Of English Literature Plant And Soil Author Guidelines

  25. Kimgal

    Kimgal on 07/30/2020 5:10 p.m. #

    [url=https://dipyridamol.com/]dipyridamole 25 mg tab[/url]

  26. Amygal

    Amygal on 07/31/2020 1:02 a.m. #

    [url=https://advair2019.com/]advair pill[/url]

  27. Kimgal

    Kimgal on 07/31/2020 9:18 a.m. #

    [url=https://elimitepermethrin.com/]where can you get elimite[/url]

  28. nziltailm

    nziltailm on 08/01/2020 1:10 a.m. #

    [url=https://www.parkerrussia.ru/pens/im/PR60R-MLT5/]паркер ручка серебро[/url] или [url=https://www.parkerrussia.ru/pens/jotter/PR50B-MLT73/]PR11K-SLR1C[/url]

    https://www.parkerrussia.ru/pens/sonnet/PR50R-MLT13/

  29. Janegal

    Janegal on 08/01/2020 8:23 a.m. #

    [url=https://stratterra.com/]strattera cap 40mg[/url]

  30. Janegal

    Janegal on 08/02/2020 7:55 a.m. #

    [url=https://hydrochlorothiazide2.com/]hydrochlorothiazide script[/url]

  31. Vania

    Vania on 08/02/2020 10:34 a.m. #

    For latest news you have to visit world-wide-web and on web
    I found this site as a finest web site for hottest updates.

  32. Vania

    Vania on 08/02/2020 10:34 a.m. #

    For latest news you have to visit world-wide-web and on web I found this site as a finest web site for hottest updates.

  33. Wimgal

    Wimgal on 08/03/2020 5:06 a.m. #

    [url=http://seroquel50.com/]seroquel 300mg[/url]

  34. Amygal

    Amygal on 08/03/2020 8:11 a.m. #

    [url=https://nolvadex10.com/]nolvadex tablet online[/url]

  35. Janegal

    Janegal on 08/04/2020 3:32 a.m. #

    [url=https://prednisonesr.com/]60 mg of prednisone[/url]

Pingbacks

Pingbacks are closed.

Post your comment