Sometimes I get carried away using Redis. Made another change a couple days ago that shaved over 12 GB off our memory usage. Probably more we can do.

condie

@manton do you have an explainer of your micro.blog tech stack in blog or podcast form? I’m working on a project that will have similar needs and I’m curious what approach you took

Miraz Jordan

Must say I’ve noticed recently that the Timeline is speedy and publishing to my blog is also speedy. You’re doing something right. 😁 Thank you.

Manton Reece

@Miraz Great to hear!

Manton Reece

@condie Not really in one place… It’s Ruby Sinatra for the web platform, Hugo for blog publishing, MySQL for most storage, also S3 for photos, Redis for storing lists of posts in the timeline. I posted a server diagram a few months ago too.

Manton Reece

@pratik 👍

JL Gatewood

I’m grateful for your memory management work. Mine is terrible apparently.😅

Simon Woods
Manton Reece

@SimonWoods @condie Oh, thanks! I forgot about that post.

Jason Garber

@manton Super curious to know what the change was that resulted in such a dramatic improvement!

Manton Reece

@jgarber I’ve been making some smaller changes, but this one was kind of dumb… I was storing some logging data in Redis and it got completely out of control without me realizing it. Moved it to MySQL.

Jason Garber

@manton Oh, interesting. Glad you found an easy solution!

Scott Yoshinaga

I wonder if one of the changes/fixes you’ve been working on fixed the Cloudflare/Imunify360 issues I’ve been having with my blog feeds. I just noticed that micro.blog can “see” my feeds again, although I think I need to manually reload them.

Manton Reece

@kimonostereo That’s great it’s working! I don’t think I’ve made any related changes but let’s hope it keeps working.

Scott Yoshinaga

Thanks! Me too! Will there be another release of the micro.blog iOS app soon? Hoping an update will fix whatever is stopping xml-rpc from connecting with my blog. For whatever reason, it still works on macOS and iPad.

Manton Reece

@kimonostereo Yes, updated iOS app coming this week. I need to revisit the XML-RPC problem, though, I don’t think it’s fixed yet.

Scott Yoshinaga

Awesome! Please let me know if there is anything I can do to help!

Scott Yoshinaga

downloaded the TestFlight beta, and yep! Still has the same issue previously.

Manton Reece

@kimonostereo Thanks, I’m going to fire up another Movable Type server to test with.

JL Gatewood

I’m also interested in this 🔖

Scott Yoshinaga

I noticed that there is a link to view logs in my account timeline RSS feeds. I’m trying to figure out why this has been working sometimes and then stops. I noticed last night there was a period of time where m.b. downloaded my feed with no errors between 2024-03-02 18:35:00 and 2024-03-02 21:03:55, then I started seeing Feed: Error parsing RSS — ohmypizza.com/micro/atom.xml and SimpleRSSError, Poorly formatted feed again. Currently the feeds page states both my feeds are Error: invalid RSS feed. Are you able to see if the feeds are actually downloaded?

Manton Reece

@kimonostereo Interesting that the error changed. I’ll test this again, but I’m also going to add a special error message when the response is HTML. That should help us troubleshoot.

Scott Yoshinaga

Thank you for helping with this. I appreciate it! RSS feeds are currently in Error: invalid RSS feed mode. Will be interesting to see if the error logs show anything interesting if/when that changes.

Scott Yoshinaga

I just checked and the feeds are working again. Can you see if there is anything that you can see on your end?

Scott Yoshinaga

morning update: feeds are still working and the feed log shows no errors.

Scott Yoshinaga

update: sometime around 10:13AM HST the feeds have stopped working.

Manton Reece

@kimonostereo Thanks for the updates. Still mysterious why this works and then doesn’t. I haven’t rolled out the better logging yet, though.

Scott Yoshinaga

thanks! I would love to know what’s happening too. It seems just random!

Scott Yoshinaga

morning update: feeds working again!

Scott Yoshinaga

Looks like feeds stopped working again at around 2024-03-10 19:38:57 according to the logs. It was fine for 3 days this time!

Manton Reece

@kimonostereo I wonder if the timing is because Cloudflare’s security mechanism is related to how often it’s getting requests from Micro.blog. If so, maybe we could work around it by adjusting checking feeds when there is an error.

Scott Yoshinaga

I’m guessing there aren’t many others with this issue? Do you think this is still related to Imunify360 or just Cloudflare. I was thinking about moving (again) to another webhost if it was Imunify360…

Scott Yoshinaga

Hi Manton! Would you happen to have any update regarding fixes for my issues posting from Movable Type on the iOS apps?

Manton Reece

@kimonostereo Not yet, I have a couple issues still to resolve with Movable Type and Micropub support too. Sorry for the delay.

Scott Yoshinaga

I started noticing a new error in the feed logs today: Feed: Unknown error 403 Forbidden, Net::HTTPForbidden

Scott Yoshinaga

I’m testing out a different web host in an attempt to “fix” my issues with micro.blog not being able to get to my RSS feed. I added a test feed but noticed that it sometimes shows: “Error: invalid RSS feed” and other times it seems fine.

Manton Reece @manton
Lightbox Image