Fluorescent Dreams Wax Cylinders - How to back up your LiveJournal

6th of January, 2009

11:05 - How to back up your LiveJournal

Previous Entry Add to Memories Tell a Friend Next Entry

Dear all,
People were asking me how to back up your LiveJournal.

Everyone
LiveJournal provides the Export Journal page, which gives you one month at a time. It only gives you the entries, not the comments.

Everyone
LJ Book converts your journal to a nice .PDF. However, everyone and their dog, cat, mouse, and bird is using it now; the site is terribly slow.

Windows
SourceForge has a program, LJ Archive. Supposedly, this program downloads both entries and comments.

Macintosh
(I used this method.) The program XJournal has a "History" page. By clicking the "download" button, you get all of your entries (but not comments.)

I haven't seen recommended methods for backing up specifically under Unix.

(Leave a comment)

Comments:

[User Picture]
From:[info]ytterbius
Date:2009-Jan-6 07:39 pm (UTC)
(Link)
Any idea if it's possible to back up a community? I don't think that LJ Book will do it.
(Reply) (Thread)
[User Picture]
From:[info]jarodrussell
Date:2009-Jan-6 08:00 pm (UTC)
(Link)
jbackup.pl is what I use on Linux.
(Reply) (Parent) (Thread)
[User Picture]
From:[info]kevinjdog
Date:2009-Jan-6 08:02 pm (UTC)
(Link)
However, everyone and their dog, cat, mouse, and bird is using it now; the site is terribly slow.

I'll wait till the panic dies down. I have faith LJ will be around a little while longer.
(Reply) (Thread)
[User Picture]
From:[info]zenicurean
Date:2009-Jan-6 08:12 pm (UTC)
(Link)
It will. Bad PR and the shock value aside, the latest sacking spree wasn't nice but it was good business sense.
(Reply) (Parent) (Thread)
[User Picture]
From:[info]kensan_oni
Date:2009-Jan-6 08:41 pm (UTC)
(Link)
Isn't this being a little reactionary? They laid off their development staff. This doesn't seem like "the world is ending" kind of thing.
(Reply) (Thread)
[User Picture]
From:[info]chipuni
Date:2009-Jan-6 08:56 pm (UTC)
(Link)
I think that having a backup is good policy, no matter whether LiveJournal lasts one month or one century.
(Reply) (Parent) (Thread)
[User Picture]
From:[info]kensan_oni
Date:2009-Jan-6 09:00 pm (UTC)
(Link)
Well, generally I agree, but the timing... why do humans always do things when their life is in the middle of a crisis?

"We should do something about global warming"
"Oh, that's a long way off."
"Hey, Gas Prices are 6 bucks a gallon. Oh, and British Columbia fell into the Arctic Ocean."
"OMG, we gotta do something now!"

So, yeah... it's just a timing issue. :)
(Reply) (Parent) (Thread)
[User Picture]
From:[info]kevinjdog
Date:2009-Jan-6 09:05 pm (UTC)
(Link)
I've been wanting to backup my LJ for some time but just didn't know how to do it. I hate the LJ archiving system they have here (CSV and XML look like crap) and didn't know about LJBook until now. So in a way I'm glad the panic happened so that I learned about a good way to get a hard copy of my LJ.
(Reply) (Parent) (Thread)
[User Picture]
From:[info]merle_
Date:2009-Jan-6 10:18 pm (UTC)
(Link)
Having a backup is also good for those of us who are faint of memory. "Hmm, did I post about X? *greps* Oh yeah, I did."
(Reply) (Parent) (Thread)
[User Picture]
From:[info]jeran
Date:2009-Jan-6 09:13 pm (UTC)
(Link)
Probably it is, but the writing's also on the wall. SUP has looked at LJ from a business standpoint, and the business is the Russian portion. That's a solid money-maker. The parts outside of Russia, the bulk of the users just don't want to pay and the advertising isn't a reliable revenue stream (plus the fact that while the advertisers really love the demographic, they're uncomfortable with what that desirable demographic really likes). I expect sooner or later SUP will start pruning out the non-paid accounts and shift the non-Russian paid accounts to "We'll take your money, but we're not developing anything that doesn't support the core Russian business.". I'd be planning to get out before that happens, so I don't have to panic at the last minute.
(Reply) (Parent) (Thread)
[User Picture]
From:[info]kvarko
Date:2009-Jan-6 10:09 pm (UTC)
(Link)
I heard about ljmigrate which is a python script (works on Mac OS X out of the box, Linux with python, and Windows with python) that captures comments, user pics, and makes a static HTML version that you can browse locally.

(Reply) (Thread)
[User Picture]
From:[info]tigrise
Date:2009-Jan-6 11:12 pm (UTC)
(Link)
I was just trying to create a local copy and not migrate. Tried using this tool, and it spammed errors because it didn't have a destination to write to. Also the stuff it did archive didn't look correct in the XML. It removed pretty much all the line wraps and formatting... and images... and everything. :/
(Reply) (Parent) (Thread)
[User Picture]
From:[info]merle_
Date:2009-Jan-6 10:16 pm (UTC)
(Link)
I found LJMigrate (Python) worked admirably on OSX. Command-line based, but there are tutorials. I don't think how it backs up is optimal (eg your posts are stored as nnnnn.html using different numbers than LJ post numbers, you don't get calendar views, etc) but it took under ten minutes to get it up and running. It also has an "update if changed" mode for recurring backups.
(Reply) (Thread)
[User Picture]
From:[info]tigrise
Date:2009-Jan-6 10:50 pm (UTC)
(Link)
I have NEVER been able to get XJournal's history feature or the LJbook.com thing to work. :( I'd donate to LJbook... if it ever WORKED. It never has.

Edited at 2009-01-06 10:52 pm (UTC)
(Reply) (Thread)
[User Picture]
From:[info]wbwolf
Date:2009-Jan-6 11:49 pm (UTC)
(Link)
It took me a while to get it to work, but I finally figure it out. The big problem I had was if you made a backup before 2006, before they made the switchover in URL format (www.livejournal.com/user/wbwolf vs wbwolf.livejournal.com), the history function won't be able to append to an existing backup.

First of all, make sure that ~/Library/Application Support/Xjournal/History.plist is writable. Also, you may want to upgrade to the latest version. (version 1.06b6 just came out a couple weeks ago) If you have an old version there, delete it. Then download your history. It will do a fresh download in XML format. You can tell an archived version from a live version because it'll be just the black and white text, none of your normal layout view.
(Reply) (Parent) (Thread)
[User Picture]
From:[info]dagoski
Date:2009-Jan-7 01:52 am (UTC)
(Link)
So, how do you actually get the history started? The interface isn't all that clear to me. When I open the history window and click download it tells me I'm downloading 0 of 0. And, thanks advance for whatever help you reply with.
(Reply) (Parent) (Thread)
[User Picture]
From:[info]wbwolf
Date:2009-Jan-7 02:01 am (UTC)
(Link)
Well, you are following the correct steps, so it sounds like something else is up. Make sure that you are logged into your account first before hitting the history button. Before you do the download, you should see the years your account has been active in the window below. Who knows, maybe you're already updated and there is nothing else to add to the archive?
(Reply) (Parent) (Thread)
[User Picture]
From:[info]dagoski
Date:2009-Jan-7 02:12 am (UTC)
(Link)
Wonder if it's due to my journal's age. I apparently started in 2002. I don't see any information when I start the window up and I know that's a problem now. Thanks for pointing me in a direction.
(Reply) (Parent) (Thread)
[User Picture]
From:[info]dagoski
Date:2009-Jan-7 02:22 am (UTC)

A Perhaps Helpful Tip

(Link)
Thanks to the wbwolf for making me think a little. If you have an old journal with a lot of activity, you might need to open the history window and let it settle a few minutes before doing any operation. I did that while spacing out on what to say next on a cover letter and then kicked off a history update. Hasn't completed yet, but I do have a progress bar that's ticking off numbers and that's, well, progress.
(Reply) (Parent) (Thread)
[User Picture]
From:[info]chipuni
Date:2009-Jan-7 04:44 am (UTC)
(Link)
Hrm.

It Just Worked for me.

I am not sure why it didn't work for you.

And I couldn't find a community here to point to you.

I'm sorry.
(Reply) (Parent) (Thread)
[User Picture]
From:[info]wbwolf
Date:2009-Jan-7 05:06 am (UTC)
(Link)
[info]xjournal seems to work
(Reply) (Parent) (Thread)
[User Picture]
From:[info]dagoski
Date:2009-Jan-7 01:47 pm (UTC)
(Link)
I did get it to work simply by letting the history window sit a few minutes before doing anything with it. I dunno what's going on, but I got a couple of kernel errors after the app quit on the first couple of trys. I think I've got a combination of old OS and long journal.
(Reply) (Parent) (Thread)
[User Picture]
From:[info]kvarko
Date:2009-Jan-6 11:51 pm (UTC)
(Link)
A friend, [info]ghewgill, wrote ljdump which was written specifically to make a local HTML backup of entries and comments and, the reason he wrote his own rather than go with an existing tool, to be easier to navigate, like when you're later looking in the archive for a post by topic or date. An example of what it generates is here. There's even a community [info]ljdump to discuss the program.
(Reply) (Thread)
[User Picture]
From:[info]xydexx
Date:2009-Jan-7 02:10 am (UTC)
(Link)
I have used LJ Archive to back up my journal previously and recommend it. It downloads posts and comments, and has a search function.
(Reply) (Thread)
[User Picture]
From:[info]drunk_bunny1
Date:2009-Jan-7 03:30 am (UTC)
(Link)
anyone know if there is a way to backup someone else's journal? a loved one passed away and LJ was kind enough to save the journal as a friends only memorial for me but i would really like to save it.
(Reply) (Thread)
[User Picture]
From:[info]chipuni
Date:2009-Jan-7 04:48 am (UTC)
(Link)
Do you have the password for the account? If so, then try any of the above solutions.

If you don't have the password, and you're on a Unix system, then PLJBackup might possibly work. (I have not tested it!)
(Reply) (Parent) (Thread)
[User Picture]
From:[info]doodlesthegreat
Date:2009-Jan-7 04:29 am (UTC)
(Link)
My only question is: what the fuck do I have on my journal that's worth saving?
(Reply) (Thread)
[User Picture]
From:[info]chipuni
Date:2009-Jan-7 04:48 am (UTC)
(Link)
Why, my scintillating comments, of course!
(Reply) (Parent) (Thread)
[User Picture]
From:[info]doodlesthegreat
Date:2009-Jan-7 07:08 pm (UTC)
(Link)
(Reply) (Parent) (Thread)
[User Picture]
From:[info]telbert
Date:2009-Jan-7 10:44 am (UTC)
(Link)
Thanks for the advice, Chip! I'm not leaving LJ, but I will be taking precautions in case LJ goes toes-up.
(Reply) (Thread)
[User Picture]
From:[info]halfmountain
Date:2009-Jan-7 06:13 pm (UTC)
(Link)
I have tried using XJournal to back everything up using "download history" but it only shows up in XJournal when I'm connected to the internet and logged in to LJ.. which tells me it isn't actually downloading much of anything. *sigh*
(Reply) (Thread)
[User Picture]
From:[info]mike0214
Date:2009-Oct-6 04:40 am (UTC)

Thanks a lot!

(Link)
I just tried LJ Archive.
It works really nice and incredible fast.
(Reply) (Thread)
[User Picture]
From:[info]chipuni
Date:2009-Oct-6 04:44 am (UTC)

Re: Thanks a lot!

(Link)
Glad this article could help!
(Reply) (Parent) (Thread)
[User Picture]
From:[info]rowyn
Date:2009-Oct-11 02:27 am (UTC)
(Link)
Y'know, I'd forgotten all about the panic back in January and you making this post. But this post is the #5 hit on Google for 'backup livejournal' (with no quotes). It actually ought to rank higher, since it was more useful than hits 1-4. :) Lj Archive is a splendid thing indeed.
(Reply) (Thread)
[User Picture]
From:[info]chipuni
Date:2009-Oct-11 03:09 am (UTC)
(Link)
*grin*

Thank you.

I recently got a comment, thanking me for this entry. I'm glad that people find it useful.
(Reply) (Parent) (Thread)