Commit graph

39 commits

Author SHA1 Message Date
66875b327e go/trains: init 2021-11-18 22:24:20 +00:00
0621fbfbf1 go/streetworks: init, schedule on totoro 2021-11-08 20:08:56 +00:00
8d7c6dfa2c twitterchiver/relatedfetcher: fix directionality of is-not-found check 2021-04-01 00:38:13 +00:00
7a48bccf36 twitterchiver/relatedfetcher: wire bucket from flag into worker config 2021-04-01 00:29:46 +00:00
3d475e0efe go/twitterchiver: port relatedfetcher to gocloud.dev 2021-04-01 00:07:41 +00:00
69aba17ba4 bvm-twitterchiver: add twitterchiver-viewer 2021-03-31 23:33:44 +00:00
12e595bf43 go/twitterchiver/viewer: fix authR 2021-03-31 23:33:35 +00:00
5924ded23d go/twitterchiver/viewer: switch media to gocloud s3 2021-03-31 21:19:57 +00:00
3a3acc4673 twitterchiver/viewer: swap openshiftauth for pomerium 2021-03-30 21:59:18 +01:00
787b04737e treewide: add some SPDX headers 2021-03-20 20:46:56 +00:00
576a45ae67 go: init twitternuke 2021-01-06 21:15:56 +00:00
013da6e7c3 go/minotarproxy: import 2020-11-04 17:10:15 +00:00
74371dbe8a totoro: add br-int interface 2020-10-31 17:04:30 +00:00
787e89c24d twitterchiver/viewer: support quoted tweets 2020-10-22 21:38:35 +00:00
7003f84fb7 twitterchiver/related_fetcher: use tweet_mode=extended (d'oh) 2020-10-22 21:15:01 +00:00
bb33b8fae0 twitterchiver/viewer: fix GIFs; large images 2020-10-22 02:05:24 +00:00
d9c5f3f74d twitterchiver/viewer: don't crop images 2020-10-22 01:33:01 +00:00
a0d730cb47 twitterchiver/related_fetcher: use quoted_status_id instead of just quoted_status.id, sometimes only one is present 2020-10-22 01:28:39 +00:00
27b1e70ac1 twitterchiver/viewer: fix media serving 2020-10-22 00:34:12 +00:00
d91b1baebc Try serving media locally 2020-10-21 23:58:23 +00:00
23c7f8e520 twitterchiver/viewer: add stats to index page 2020-10-21 02:04:34 +00:00
0da26f3e42 twitterchiver/related_fetcher: move the fetch token counter to right before we do the fetch 2020-10-21 01:24:30 +00:00
e49cb8eb05 twitterchiver/related_fetcher: up the work-cap, but introduce an absolute cap on number of tweets actually fetched 2020-10-20 23:30:50 +00:00
cab1df2966 twitterchiver/related_fetcher: treat 403 as deleted as well 2020-10-19 23:57:44 +00:00
e6180a6850 twitterchiver/related_fetcher: add separate flags for tick interval/work for each worker 2020-10-18 21:23:26 +01:00
297fc79db0 twitterchiver/related_fetcher: mark tweets as media-fetched if they have no media 2020-10-18 21:12:37 +01:00
be71055ea1 twitterchiver/viewer: restrict viewing to on_timeline tweets
We want to only display tweets in the search view that was in timeline, but
we do store entries in user_accounts_tweets for ACL purposes for replies/quote tweets.
2020-10-18 21:07:55 +01:00
50895e2aa3 twitterchiver/related_fetcher: fix marking tweets as done if they had no related content 2020-10-18 21:02:17 +01:00
cc8f24e8e1 twitterchiver: add relatedfetcher, to fetch referenced media and tweets 2020-10-18 20:44:50 +01:00
4466be3776 twitterchiver/viewer: set retweeted icon to grey 2020-10-18 01:08:47 +00:00
0d8ff4ba40 twitterchiver/viewer: add titles to pages 2020-10-18 01:08:12 +00:00
c5a53d9334 twitterchiver: init viewer 2020-10-18 01:02:46 +01:00
04c3a8431b go/openshiftauth: init
This is a small "library" for wrapping binaries with magic OAuth authentication based on the automatically-injected k8s service account tokens and OpenShift's OAuth service.

There's an example of this deployed at https://example-lukegb-openshiftauth-test.apps.k8s.lukegb.tech/.

The main pieces of setup that need to happen is:

* Set "serviceAccount" in pod definition
* Add Route for pod
* Edit serviceaccount and add metadata.annotations, e.g.:
    serviceaccounts.openshift.io/oauth-redirectreference.first: >-
      {"kind":"OAuthRedirectReference","apiVersion":"v1","reference":{"kind":"Route","name":"example"}}
2020-10-04 14:38:56 +01:00
9bd61285a7 third_party/gopkgs: import some more packages 2020-10-04 14:36:31 +01:00
b71cc68f24 go: move go.mod to go folder 2020-10-04 11:33:08 +01:00
014d1c881a twitterchiver/archiver: store mapping of tweet ID to user ID that saw it 2020-10-04 03:42:02 +01:00
c384c31248 twitterchiver: move archiver to subattribute 2020-10-04 01:25:36 +01:00
dd3c58548d go/twitterchiver: init 2020-10-04 01:07:59 +01:00
00c94273fd go/twitterchiver: init 2020-10-04 00:17:35 +01:00