Commit graph

50 commits

Author SHA1 Message Date
Luke Hanley (LukeHandle)
516ee3e20a go/minotarproxy: clean up Prometheus metrics 2022-01-22 15:28:31 +00:00
086f5fe597 journal2clickhouse: coerce things that look like strings back to strings
There's binary data sometimes, but on the whole I don't care about preserving
it properly (sorry), so let's just coerce it to a string if it is supposed to
go into a "proper" field.
2022-01-01 16:30:38 +00:00
7e848a2622 go/journal2clickhouse: fix the Classic Bug 2022-01-01 15:31:47 +00:00
c91a42948d journal2clickhouse: init 2022-01-01 15:08:52 +00:00
060f2cf96b nhsenglandtests: init 2021-12-31 07:00:32 +00:00
5f0326b484 go/trains: ease up on some crashy behaviour 2021-12-07 15:19:29 +00:00
1f34692907 go/trains/cmd/train2livesplit: fix 2021-11-25 17:33:05 +00:00
1eda43af34 go/trains: go! trains! 2021-11-23 12:32:01 +00:00
c9cc5cc5f4 go/trains: start work towards gRPC API; add FCM topic publisher 2021-11-20 23:46:53 +00:00
7af28f3ef5 go/trains: split summarizeService into its own package
It might come in handy when sending push notifications to devices...
2021-11-20 19:12:47 +00:00
4f3356727a go/trains: use protos for defining the web API
This will probably be useful later when I make the web app...
2021-11-20 19:06:43 +00:00
66875b327e go/trains: init 2021-11-18 22:24:20 +00:00
0621fbfbf1 go/streetworks: init, schedule on totoro 2021-11-08 20:08:56 +00:00
8d7c6dfa2c twitterchiver/relatedfetcher: fix directionality of is-not-found check 2021-04-01 00:38:13 +00:00
7a48bccf36 twitterchiver/relatedfetcher: wire bucket from flag into worker config 2021-04-01 00:29:46 +00:00
3d475e0efe go/twitterchiver: port relatedfetcher to gocloud.dev 2021-04-01 00:07:41 +00:00
69aba17ba4 bvm-twitterchiver: add twitterchiver-viewer 2021-03-31 23:33:44 +00:00
12e595bf43 go/twitterchiver/viewer: fix authR 2021-03-31 23:33:35 +00:00
5924ded23d go/twitterchiver/viewer: switch media to gocloud s3 2021-03-31 21:19:57 +00:00
3a3acc4673 twitterchiver/viewer: swap openshiftauth for pomerium 2021-03-30 21:59:18 +01:00
787b04737e treewide: add some SPDX headers 2021-03-20 20:46:56 +00:00
576a45ae67 go: init twitternuke 2021-01-06 21:15:56 +00:00
013da6e7c3 go/minotarproxy: import 2020-11-04 17:10:15 +00:00
74371dbe8a totoro: add br-int interface 2020-10-31 17:04:30 +00:00
787e89c24d twitterchiver/viewer: support quoted tweets 2020-10-22 21:38:35 +00:00
7003f84fb7 twitterchiver/related_fetcher: use tweet_mode=extended (d'oh) 2020-10-22 21:15:01 +00:00
bb33b8fae0 twitterchiver/viewer: fix GIFs; large images 2020-10-22 02:05:24 +00:00
d9c5f3f74d twitterchiver/viewer: don't crop images 2020-10-22 01:33:01 +00:00
a0d730cb47 twitterchiver/related_fetcher: use quoted_status_id instead of just quoted_status.id, sometimes only one is present 2020-10-22 01:28:39 +00:00
27b1e70ac1 twitterchiver/viewer: fix media serving 2020-10-22 00:34:12 +00:00
d91b1baebc Try serving media locally 2020-10-21 23:58:23 +00:00
23c7f8e520 twitterchiver/viewer: add stats to index page 2020-10-21 02:04:34 +00:00
0da26f3e42 twitterchiver/related_fetcher: move the fetch token counter to right before we do the fetch 2020-10-21 01:24:30 +00:00
e49cb8eb05 twitterchiver/related_fetcher: up the work-cap, but introduce an absolute cap on number of tweets actually fetched 2020-10-20 23:30:50 +00:00
cab1df2966 twitterchiver/related_fetcher: treat 403 as deleted as well 2020-10-19 23:57:44 +00:00
e6180a6850 twitterchiver/related_fetcher: add separate flags for tick interval/work for each worker 2020-10-18 21:23:26 +01:00
297fc79db0 twitterchiver/related_fetcher: mark tweets as media-fetched if they have no media 2020-10-18 21:12:37 +01:00
be71055ea1 twitterchiver/viewer: restrict viewing to on_timeline tweets
We want to only display tweets in the search view that was in timeline, but
we do store entries in user_accounts_tweets for ACL purposes for replies/quote tweets.
2020-10-18 21:07:55 +01:00
50895e2aa3 twitterchiver/related_fetcher: fix marking tweets as done if they had no related content 2020-10-18 21:02:17 +01:00
cc8f24e8e1 twitterchiver: add relatedfetcher, to fetch referenced media and tweets 2020-10-18 20:44:50 +01:00
4466be3776 twitterchiver/viewer: set retweeted icon to grey 2020-10-18 01:08:47 +00:00
0d8ff4ba40 twitterchiver/viewer: add titles to pages 2020-10-18 01:08:12 +00:00
c5a53d9334 twitterchiver: init viewer 2020-10-18 01:02:46 +01:00
04c3a8431b go/openshiftauth: init
This is a small "library" for wrapping binaries with magic OAuth authentication based on the automatically-injected k8s service account tokens and OpenShift's OAuth service.

There's an example of this deployed at https://example-lukegb-openshiftauth-test.apps.k8s.lukegb.tech/.

The main pieces of setup that need to happen is:

* Set "serviceAccount" in pod definition
* Add Route for pod
* Edit serviceaccount and add metadata.annotations, e.g.:
    serviceaccounts.openshift.io/oauth-redirectreference.first: >-
      {"kind":"OAuthRedirectReference","apiVersion":"v1","reference":{"kind":"Route","name":"example"}}
2020-10-04 14:38:56 +01:00
9bd61285a7 third_party/gopkgs: import some more packages 2020-10-04 14:36:31 +01:00
b71cc68f24 go: move go.mod to go folder 2020-10-04 11:33:08 +01:00
014d1c881a twitterchiver/archiver: store mapping of tweet ID to user ID that saw it 2020-10-04 03:42:02 +01:00
c384c31248 twitterchiver: move archiver to subattribute 2020-10-04 01:25:36 +01:00
dd3c58548d go/twitterchiver: init 2020-10-04 01:07:59 +01:00
00c94273fd go/twitterchiver: init 2020-10-04 00:17:35 +01:00