offline-twitter/doc/TODO.txt

126 lines
4.5 KiB
Plaintext
Raw Normal View History

2022-01-08 19:50:14 -05:00
TODO user-images-extract-to-table:
User profile images and banner images => extract to table. Add `is_downloaded` column. Add test for double-downloading a user, shouldn't change the write-times on these files
2022-03-02 16:15:12 -08:00
TODO update-all
2022-01-08 19:50:14 -05:00
TODO broadcast-cards
panic: Unknown card type: 3691233323:periscope_broadcast
panic: Unknown card type: 745291183405076480:broadcast
2022-01-19 17:20:52 -08:00
2022-12-24 14:39:04 -05:00
TODO video-bitrates
2022-01-19 17:20:52 -08:00
- add "bitrate" and "available bitrates" fields
- option to upgrade or downgrade video quality
2022-02-12 16:04:54 -08:00
TODO: videos-view-count
- videos don't parse properly in APIv2
2022-02-28 16:16:36 -08:00
TODO video-not-downloading: https://twitter.com/JustinPulitzer/status/1496709662602932224
2022-03-02 16:15:12 -08:00
2022-05-07 19:26:02 -07:00
TODO get-user-tweets-user-doesn't-exist
2022-10-15 16:52:45 -04:00
TODO bash-completions
- Should have bash completions.
2022-12-24 14:39:04 -05:00
TODO twitter-spaces
- add `is_details_available` flag
2023-03-09 22:55:02 -05:00
TODO authenticated-requests
- media tab
- quote-tweets
TODO post-tweets
2023-06-26 15:33:29 -03:00
- post tweets
- reply to a tweet
- quote-tweet a tweet
- retweet a tweet
2023-03-09 22:55:02 -05:00
2023-06-21 16:02:08 -03:00
TODO spaces-fetch-participants-info
- some user information is available in a Spaces result. Right now we just render them as null users (handle = "", id = 0) if they're not fetched already
2023-06-07 15:44:25 -03:00
- distinguish whether someone was an admin in the space or not
2023-06-21 16:02:08 -03:00
TODO spaces-fetch-sharings
- you can fetch the stuff that was posted in the jumbotron
2023-06-07 15:44:25 -03:00
TODO tweets-with-italics
- https://twitter.com/exit_org/status/1656813511572443141
TODO authenticated-only-request-warning
- warn when attempting to run requests which require authentication without a session active
2024-03-22 21:53:45 -07:00
- right now it will try and then produce an HTTP error (404)
2023-06-08 20:48:30 -03:00
2023-06-21 16:02:08 -03:00
TODO unknown-user-upgrading
- if an unknown user (created to satisfy SQLite integrity check on user_id foreign key) has user details fetched, the "Join Date" and other zero-value fields should update with the new value
TODO apiv2-tombstones
- on Tweet Detail:
- tombstones in replies to the focused tweet
- on User Feed:
- tombstones (e.g, "Age restricted") that show up as top-level entries
- keep in mind that these might be retweets; the entry-id is the RetweetID, not the TweetID
2023-08-18 19:32:10 -03:00
TODO tidy-up-command-line-flags
- make flags that are part of a subcommand go after that subcommand (e.g., `twitter get_user_tweets -n 200 ...`)
TODO: mobile-requests
- implement mobile versions of various requests
- Check in `pkg/scraper/test_responses/mobile_requests`
TODO: search-bottom-cursor
- Entry type "TimelineReplaceEntries" that replaces the cursor in the timeline instead of the new timeline having a new one
- As first step, need helper function that returns the []Instruction element in a APIV2Response (not just the MainInstruction which is TimelineAddEntries)
- since different requests have different paths to the Instructions, e.g., Data.User.Result.Timeline.Timeline.Instructions vs Data.Home.HomeTimelineUrt.Instructions, etc
2023-10-14 20:30:44 -03:00
TODO: newer-version-tombstone
- Preserve tombstone after re-scraping
2024-02-19 18:05:23 -08:00
TODO: failed-tweets
- https://twitter.com/_HARVEY__DENT_/status/1755665502385377720
2024-02-25 22:19:07 -08:00
- "Empty tweet": https://twitter.com/wispem_wantex/status/1581333495393107968
2024-02-19 18:05:23 -08:00
TODO: new-content-type
- https://twitter.com/itsbackwereover/status/1757947530506043872
2023-08-18 19:32:10 -03:00
Webserver
---------
TODO: SQL-logger
TODO const-select-fields
- There's a few queries that use "select ..." and write out all the fields. Put the field names in one spot
TODO compound-query-structs
- Right now the result structs for the compound queries (e.g., "Feed", "TweetDetail") are in the `persistence` package. They don't go there probably
TODO: login-routes-tests
2023-08-18 19:32:10 -03:00
- Make the scraper.API object injectable somehow (get rid of singleton pattern) and add tests for login and change-session sequences
- Also test profile.ListSessions()
TODO: webserver-session-arg-active-user
- make the active user get set on initializing the Application object if a --session flag is given
TODO: show-errors-in-UI
- if an HTTP request fails, show an error in the UI somehow
2024-02-25 22:19:07 -08:00
- scrape failed due to rate limiting
- non-HTMX 500 errors now show a weird HTML page
2023-08-31 18:39:44 -03:00
2023-10-14 20:30:44 -03:00
TODO: refactor-compound_queries_test-file
- Move the tests for user feeds into the compound_queries_ssf_test file
2024-05-04 21:49:23 -07:00
TODO: incomplete-threads
- when previous tweet in thread is missing, put a "fetch tweet" button to get it
2023-12-24 22:43:14 -06:00
2024-02-19 18:05:23 -08:00
TODO: dms
2024-03-22 21:53:45 -07:00
- add search
2024-02-19 18:05:23 -08:00
TODO: search-terms-highlighted
- on Search page, highlight matches for the search keywords
2023-12-24 22:43:14 -06:00
2024-03-03 15:31:58 -08:00
TODO: profile-image-template
- There are a lot of places that use a circle profile image aside from author-infos
2024-02-25 22:19:07 -08:00
Windows Build
-------------
TODO: windows-session-list
- Check that sessions load as @Offline_Twatter instead of @test\Offline_Twatter on Windows