Reinstalling Ubuntu

One thing that really frightens me is reinstalling an OS and keeping the "lights on" with regards to my personal data and extra apps.  For this reason, I have never reinstalled the OS on my main workstation.  In fact, when I upgraded from an old dell laptop to a desktop machine, I only moved the HDD over and ran it as is.  The original install was 32 bit and was at least 7 years old.

Not that I don't upgrade.  It started as plain Ubunutu.  It didn't take long before I decided I was a KDE person and I "converted" it to Kubuntu.  At some point the new KDE came out and I decided to try unity since by that time it was already part of the upgrade.  It didn't take long to throw that out and "convert" my dist into Xubuntu.  I've been happy with Xfce but I could tell there was a lot of cruft running around from the previous desktops.

Enter windows 8.  Back when I bought my new desktop, it came preinstalled with win8 and had UEFI enabled.  Since I was reusing my old install, it required a legacy bios and I was relieved to find that the PC bios supported legacy mode.  However, this meant that windows 8 was no longer bootable.  I could live with that though.  Until I wanted to install a game for windows on my PC.

After doing a little googling, it appeared that grub now supported UEFI and I found this nifty program boot-repair which aims to fix things properly.  So I tried to flip the switch to UEFI and try boot-repair only to be told that my current linux install was not compatible with UEFI.  I believe it was because it was 32 bit.   This put me over the edge to do the upgrade to a proper Xubuntu 64 bit install since it is not possible to upgrade from 32 to 64 bit in place.

I made to sure to tell the installer to reuse the existing partition.  This left my home dir intact.  Some of my old /usr/local installs no longer worked, and I had to remember or discover which extra packages I had installed (digikam and kmymoney for example).  But that was mostly quickly solved.  The only rub was that it seemed at some point my gpg public key ring was replaced by an empty one.  My secret ring was still in place, but gpg won't run without the public key.

I am still not sure what happened, but thankfully I did back up my home dir to the windows partition before installing Xubuntu and was able to copy my public ring back and all looks good.

Hopefully this is the last I have to write about this experience.  It went surprisingly well - even to the point where it seemed less painful than an upgrade.

Trapped between a verizon and a comcast

I have no love for either provider.  My verizon bill went way up unexpectedly this month which triggered my "switch to the other guy" clause.  Here is my chat with verizon about trying to fix my cost.

Live Chat Transcript

It was a pleasure to assist you. Your chat session has ended. Thank You. 

Your chat ID number is 11161383280.

Please select Exit to close this window.

Print

Exit

Chat Subject:Upgrade Existing Services

Your Question:Convert to digital voice

A Verizon Service Representative will be with you shortly. Thank you.

09:28:47 We apologize for the delay.You are next in the queue. A representative will be with you shortly.

Agent Kim has joined. (09:28:47)

Kim : Chat ID for this session is 11161383280. (09:28:47)

Kim(09:28:57): Thank you for choosing Verizon and visiting our chat service. I would be happy to assist you with your question.

For quality and security purposes, your session is recorded and may be monitored or reviewed. Please do not provide sensitive information such as social security, bank account or credit card numbers to the chat agent. May we view your selections and/or account information, including any services you subscribe to, which are displayed to you on verizon.com, so that we may assist you with respect to available Verizon products and services? Under federal law, it is your right and our duty to protect your account information. May I have your permission?

ANDREW BARBER(09:29:15): yes

Kim(09:30:31): Hi Andrew! Thank you for being a valued Verizon customer. I will be glad to assist you.

Kim(09:31:06): To be sure, would you like to change your home phone to Digital Voice?

ANDREW BARBER(09:31:16): I am thinking about it, yes.

Kim(09:33:06): Great! Let me first help you with the link so that I can help you with the steps to make the changes now online.

Kim(09:33:46):http://www.verizon.com/ForYourHome
Please click the above link and let me know once the next page is up.

ANDREW BARBER(09:34:50): page is up

ANDREW BARBER(09:35:26): don't see any bundles I like

Kim(09:35:56): Perfect! Could you please share what all plans you currently have?

ANDREW BARBER(09:37:39): I have 15/5 internet and regional value calling

ANDREW BARBER(09:37:50): But you should know that already

Kim(09:38:20): Thank you for sharing the information.

Kim(09:38:35): Now let me help you with the steps to check the Digital Voice plan.

Kim(09:39:00): Are you able to see "Create your own bundle" section on your account page?

ANDREW BARBER(09:39:07): yes

ANDREW BARBER(09:40:19): Let me short-cut this process. I can go to comcast and get internet and digital voice for 39.99 per month. What do you have to offer? I only want internet and digital voice.

Kim(09:41:39): As you already have the service so let me help you with the steps to check the price.

Please allow me to help you with the steps.

Kim(09:42:29): Under "Create your own bundle" section, please uncheck TV and select the internet plan and Digital Voice Unlimited.

Kim(09:42:40): Please let me know what price you are able to see for your account.

ANDREW BARBER(09:43:31): 79.99

Kim(09:46:26): Perfect! You would be able to get FiOS Internet and home phone for $79.99/mo.

The other service providers are does not offer 100% fiber optics straight to your home.

ANDREW BARBER(09:46:38): That doesn't mean anything

ANDREW BARBER(09:47:00): I've experienced both and I can tell you there is no noticeable difference

ANDREW BARBER(09:47:16): So, that is not worth $480 per year to me.

Kim(09:48:01): I do understand your concern for price; however, this is the best price you would be able to get with the FiOS service for the bundle.

ANDREW BARBER(09:48:34): Can you transfer me to customer retention department?

Kim(09:49:55): Sure! I'll be able to transfer your chat; however, the online price will be same and you will get the same price for the bundle.

ANDREW BARBER(09:50:46): Thank you.

Kim(09:51:26): Would you like me to transfer your chat?

ANDREW BARBER(09:51:33): Yes please.

Kim(09:52:18): Please hold for a moment while I transfer yout chat.

This session is being transferred. (09:52:28)

This session is transferred to Lynette. (09:52:43)

Agent Lynette has joined. (09:52:43)

Lynette : Chat ID for this session is 11161383280. (09:52:43)

Lynette(09:53:03): Hello. Thank you for choosing Verizon and visiting our chat service. I will be happy to help you today.

For quality & security purposes, your session is recorded and may be monitored or reviewed. Please do not provide sensitive information such as social security, bank account or credit card numbers. May we view your account information, including the services you subscribe to, so that we may assist you during this chat with respect to available Verizon products and services? You may deny us permission, which will have no effect on your current services. Under federal law, it is your right and our duty to protect your account information.

May I have permission to review your account?

ANDREW BARBER(09:53:53): yes

Lynette(09:55:28): The offers provided by Verizon are shown online and are unable to be changed. If you would like to speak to someone in regards to canceling your services, you may call in directly to (800) 837-4966 and they will be able to place the order for you at that time.

Lynette(09:55:33): Thank you for choosing Verizon, we appreciate your business. The department to which we have referred you will be able to assist you. If you have any additional questions, please do not hesitate to contact us again.

Your session is now closed.

Welcome to Verizon Live Chat

Print

Copy to Clipboard

Privacy Policy | © 2013 Verizon

Misterhouse notes

Just some notes for myself about recent learnings around misterhouse and insteon.

Device Linking

From what I understand now, when adding a new device to my network, I need to link it with the PLM.  To respond to the PLM (and by proxy MH) , I generally don't have to do anything but set up the device in the MHT file.  Newer devices this year, however, have changed the protocol, and MH can longer automatically discover and link the devices into the PLM as a responder to the PLM.  So, for newer devices, I have to manually link by using the set button on both the device and the PLM.  

For Linc devices, linking is a two way street since the device can send status to MH when the button is pressed.  For this, I generally have to hold the device's set button for 3 seconds, and then in MH under the PLM control, select "complete linking as responder".    It may vary by device on how to put it into link mode as a controller (ie update the PLM when the button is pressed).

Email troubles

Today I received an email from the guy that runs the server I use as a mail relay.  Apparently, my asterisk box has been sending constant email to his mail server (smart host forwarding).  I think what was happening is that I had set my .forward on the asterisk box to send to "user@host" where host is my own server at home.  That server uses exim4.  I really could never figure out how to make "user@host" stay local.  Via some trial and error I finally found that "user@mydomain" seems to work and the email isn't forwarded to the smart host but stays put on my server.  I just need to remember this in the future, hence my post here to remind me.

UPDATE:
I didn't have it quite right before.  A couple of issues.  First, the asterisk box wasn't delivering email to local users.  Instead it punted and sent it to the relay which didn't recognize it either.  This was fixed by setting mydestination to "localhost, <myhostname>" in the postfix config file.  After that, mail would get delivered locally when using unqualified user names for the email address, as well as user@<myhostname>.  The second issue was that my exim4 main mail server didn't recognize user@hostname (where hostname is the exim4 server name) as being local and would send it to the relay.  This is the same problem the asterisk server had, but this is fixed in update-exim4.conf.conf by setting dc_other_hostnames to include the exim4 server name.  It previously only had my domain name in it which is why user@<mydomain> was getting delivered locally.

Typical

I hate it when this happens but it happens far too often with upgrades.  I upgraded my laptop to Ubuntu 12.04 (which is another post to be made).  About a month later (today) I need to put some photos from my camera into digikam.  When I start up digikam I get this error:


You have insufficient privileges on the database.
Following privileges are not assigned to you:
CREATE TRIGGER
Check your privileges on the database and restart digiKam.

A google search turns up https://bugs.kde.org/show_bug.cgi?id=262321 ( a Jan 2011 bug)

Basically, some change was made to digikam in how it uses the database, but it doesn't quite work right with mysql.  The work around is to give the digikam user full privs on the entire mysql database.

There is this comment:

--- Comment #15 from davidebasilio <marsicanbear gmail com>  2011-11-07 16:12:55 --- 
Digikam 2.3.0 is out http://www.digikam.org/drupal/node/632
But it looks like noone took care of this bug since 2.0.0 
Will it ever be fixed? 
BTW, this is tagged as wishlist, but I do not really think that's correct. This 
is a bug. 


</end comment>


So, it's almost 18 months later and this is a still an issue!  The glacial pace at which these fixes get introduced combined with the super fast pace new features (and bugs) get introduced really frustrates me.  Now I have to do a work around which some years later will cause some problem and I'll never make the connection.


Check out this comment from the bug:

Bruno Friedmann 2011-03-31 08:13:20 UTC

Marcel, in fact I don't know how you can do that, due to upstream (bug/feature) the creation of triggers apparently are root reserved in mysql, due to replication feature of the database engine. ref http://dev.mysql.com/doc/refman/5.0/en/stored-programs-logging.html So for the "normal" embedded mysql there's no troubles as it's run like superuser by end user. The real impact is about using digikam in shared mode (centralized mysql server). So digikam can said : hey we didn't support that, but as it has, it will become a big regression. Time to interface digikam to virtuozzo ? :D

I mean, why do they offer the option to run shared mode if they aren't going to make sure it works on every release?  This is one of my big gripes about FOSS software - they build lots and lots of doors that you can open, but only a few will lead you to safety and many lead you to your doom (although they appear perfectly safe).  I chose the door to using a shared mysql server and I am now paying the price.




UPDATE (6/25)--
I finally got digikam working again.  There were numerous issues and I am not sure which one was the culprit.  First, some operations in mysql gave me errors or warnings about some mysql internal tables that had the wrong number of fields (20 vs 16).  It seemed this was due to an upgrade that didn't complete normally.  I ran mysql_upgrade --force and complained about some ampache tables that needed repairing.  After that it gave me this error:

Error: Incorrect database name '#mysql50#mysql.orig'

I had to remove the mysql.orig directory from /var/lib/mysql

 After fixing those, it seemed to update the database correctly.  The other thing I did (and maybe this wasn't required) was add the
create_index_if_not_exists() proc to the digikam databases per this bug (https://bugs.kde.org/show_bug.cgi?id=276052).

Now digikam works again.  But if you search for "digikam failed to upgrade" you will see lots of threads talking about failures to upgrade the schema for digikam from 5 to 6.

Ampache woes

So at some point something went horribly wrong with my ampache setup. I decided to try the ampache script that renamed files using the tag information. This seemed like a good idea, because my files weren't all named or organized in a consistent way. After a couple attempts, I noticed that all my songs in ampache were by an artist who's name started with the directory path to the file. Great. At the time I was pretty sure I had messed up the mp3 tag data because after rebuilding the catalog in ampache, nothing changed. Artist name was still the directory name (/mnt/usb_mmedia/music/itunes/...). I tried to fix things a couple times but I seemed to make it worse.

Fast forward maybe a year to the past week. I decide it's time to go fix my library. I wanted to start by fixing the MP3 tags, so I downloaded some utils and started to work. But I couldn't find anything wrong with the mp3 tags. The artist was correct here. I also noticed when playing a song through ampache that the artist name seemed to come out correctly there as well. So what the heck is going on?

I start putting print statements in the ampache code to see what it is doing when I verify the catalog. I eventually discover that it is not looking up mp3 tags when building the catalog and instead trying to generate the information from the filename. This is happening because I no longer had an entry in the ampache config file for mp3 tag processing order. I put that back in and everything goes back to normal in Apache.

So why was I missing that config line? It goes back to another problem I had with ampache where catalog verification/creation would hang at some point as the mp3id library would get stuck and chew up memory. This was a known issue with ampache which happened on some files who have corrupted tag information. It was quite hard at the time to identify which files these were and besides, I didn't know how to fix them. The only option was to stop ampache from reading the mp3 tag information by removing the tag order config key. It worked find until I tried to verify the catalog.

This is exactly why I do not like to employ hack work arounds, they always come back to bite you later.

The other stupid thing about all this is that ampache was using a deprecated php method (eregi) and would spit out errors during catalog verification. The response from the ampache devleoper was to downgrade php to an older version or use the alpha version of ampache. Really? What kind of choice is that? Have you ever tried to downgrade something in linux? Remember these systems are a tight-nit web of dependencies. You can't just go around back-revving major packages. I don't know how the stable version of ampache was even going to work on recent distribution releases. I had to replace all the calls in the ampache source code with the proper methods, then everything worked. Thanks open source!

Long time, no update again

Well, I am still on Ubuntu 10.10. I plan on using LTS releases only, but even then the support isn't there. Case and point:

https://bugs.launchpad.net/ubuntu/+source/indicator-application/+bug/569273

So, my gnome-power-manager looks like this:
Size: 443168 kB
Rss: 411364 kB
Pss: 411364 kB
Shared_Clean: 0 kB
Shared_Dirty: 0 kB
Private_Clean: 72 kB
Private_Dirty: 411292 kB
Referenced: 309920 kB
Swap: 31704 kB
KernelPageSize: 4 kB
MMUPageSize: 4 kB


Seems pretty excessive.

This is ridiculous. I would think that the gnome-power-manager is a fairly important piece of the OS here. Why in 18 months hasn't this been fixed in Ubuntu? OSS support sucks. Sure, make the argument that paid software isn't much better, but why would OSS hold itself to that shitty bar? When is Ubuntu going to be a robust complete product? Never. That's how OSS works. Constantly changing and never stable. Even the stable stuff isn't a safe bet because if you find a bug, odds are they've already moved on to a newer, better version with different bugs for you to discover. Nobody fixes bugs on old releases. Not even Ubuntu, even when it's in the support window.