Breakage, updated…

It turns out I didn’t break my WordPress install. But my home IP address *had* changed, and I have lots of things locked down to specific IP addresses for access. So I’ve got two of the three sites puzzled out. But one of them appears to have a broken theme directory. I’ll be looking into that now…

[A few minutes later, after looking at logfiles] Yup – the twentyeleven theme needed fixing on another site – I refreshed the whole thing, and I’ll keep a close eye on it in the next short while. I don’t remember mucking about in there … but it’s possible.

Yard, Themes

This weekend, I was working in the yard. The garden beds, they are ready for plants:

Garden Bed Prep - 2015

Garden Bed Prep – 2015

That, along with mowing the lawns, twice, and cleaning out all of the front flower beds, took up most of Friday and Saturday. Sunday was rest (or its best friend, immobility).

*      *      *

Theme update: The theme, it is currently a bit hideous, but now mobile friendly, due to changes in how Google search results will be ranked. Here’s a useful link on the topic from Digital Trends. Expect more work on this over the coming days.

*      *      *

Tech. Sgt. Anthony E. Salazar, 40, of Hermosa Beach, California, died April 13, at an air base in southwest Asia in a non-combat related incident. Our condolences to his friends and family.

All About Security

I spent my weekend attending talks at the inaugural BSides Charm City. BSides puts on several regional security conferences, and I’m glad they expanded into this geographic. Two full days of security talks has made my head explode, and now I’m a full week behind the curve on getting the yards ready for spring, but all good. I learned a lot! The conference sold out this year, but I am given to understand that they’re moving to a larger venue next year, so if you’re in the area and want to spend a little bit of money on a whole lot of value, join me there in 2016.

*      *      *

Spc. John M. Dawson, 22, of Whitinsville, Massachusetts, died April 8, in Jalalabad, Afghanistan, of wounds suffered when he was attacked by small arms fire while he was on an escort mission. Our condolences to his family and friends.

 

Ice

The weather liar says this is the first day of meteorological Spring. The weather itself says, “ICE!” They’ve been treating the roads and such, but there’s an eighth to a quarter inch of ice on lots of the rest of our area. Trees are deeply unhappy, with branches coming off due to weight. Lovely, really. And such a pleasure when taking the dog for a walk.

Today: Patching systems remotely for work, weekly food shopping, roasted coffee:

Roasted a Columbian today

Roasted a Columbian today

I generally roast early enough that the beans have enough time to rest for at least three days (and outgas most of the CO2) before first grind and brew. No different today: We’ll probably be drinking off of this Columbia SO coffee by Thursday.

I also cleared most things out of Marcia’s front sewing room, and did wall work: sanding and re-spackling. Later in the week, I should be able to get the shoe moulding installed, do the final sanding, and get some primer on the walls with the intention of color coat on the weekend. We know where intentions lead, yes?

*      *      *

In computing news, I puzzled my way through getting bhyve (the BSD Hypervisor) running on Serenity, the FreeBSD workstation/home server. It’ll be better to experiment with things in a virtual machine, than directly on the host. What I wasn’t able to do was get the tap and bridge networking up and running while *also* using PF, the host-based firewall. I like using firewalls as one layer in a robust security posture … but for now, not so much. The first experiment: PostgreSQL. I’ve worked some with Oracle’s database, and with MySQL (and the MariaDB fork thereof). But there are capabilities in PostgreSQL that I want to explore, and a small Python based project I’d like to write to spend some time with both the language and the database. More if there’s more to report at a later date.

*      *      *

Gladly observed: still no new casualties announced by DoD in the most recent week. Ciao!

Rainy Days and Sundays

Well, they don’t get me down, but when it’s rain drops with little ice spears embedded in each one, it’s not a pleasant thing to be walking in (or loading the groceries into the car during, for one executed example). We had about 2cm of rain today – at peak, the sump pump was running every two minutes.

Today was productive on the home front: Shopping, Laundry, cleaned up my office. I also opened up Serenity, the home server, and replaced the back panel fan with one that has manual speed settings, so that I can knock down some of the noise in here. Works like a champ. The Asus board that had been in that chassis did a better job of controlling fan speeds. When I replaced it with a SuperMicro board (and a Xeon processor + 16G of ECC RAM) … well, the SuperMicro seemed to run that back fan at full throttle the whole time.

Yesterday was productive for work: I spent 6 hours at the front part of the day planning and scripting for some VMware updating work, and 5 hours executing on it last night from 8 PM to 1 AM. Tomorrow is a relax day, I plan. Plans always work out, right?

Marcia is doing great. She’s continuing to nail her PT goals, and we expect that I’ll be going to work for several hours each day this next week, barring any setbacks.

*      *      *

It’s been more than a month! DoD announced no new casualties in the last week. The most recent reported casualty was on 14 Dec 2014.

Year Winding Down

We’re about two weeks out, and at 36″+,  just a little under eight inches shy on precipitation compared to annual normal. Of course, the tree abutting the deck has put on some bulk in the last couple of years, and it’s entirely possible that the current siting of my rain gauge is in tree shadow part of the time. I’m thinking of re-siting it (or even getting a more comprehensive weather thing) in the next year. But that’s a project for another day (month?).

But this year certainly has flown by.

*      *      *

If you saw what I was working on last week, you’ll be pleased to know that I got the sump pit monitor (incorporating a Raspberry Pi, an HC-SR04 Ultrasonic Sensor, and code courtesy of Al Audet) functioning and in place yesterday. The most recent output: “21:06:05,8.0” – That’s eight centimeters of water above pit low. Eventually I’ll graph some of the data, but right now I’m just happy that it’ll send me a text if the water gets too high. There ware a couple of gotchas in the distributed code that I’ll want to document and get back into the public code base – mostly just comments that need to be in the raspisump.conf file to ensure that configuration items are done properly so that people don’t make the same mistakes I made.

*      *      *

I also got some coffee roasted, applied polish and elbow grease to my dress shoes, had a couple of good days on the elliptical, and finished up the monthly patch cycle of a batch of $FIRM systems (late Saturday night and early Sunday morning). What am I forgetting: that doesn’t seem like enough stuff to fill a weekend. Hmmm, oh, yeah: Shopping. Sending some ZFS filesystem snapshots from a production host to a copy of said host for testing purposes. Email read and responded to. Tickets reviewed, commented upon, and resolved, as appropriate.

*      *      *

Recent Reading: I’ve been re-reading Neal Stephenson’s Cryptonomicon on the phone in dribs and drabs. I use the phone as dead-time reading because I don’t carry the Kindle or any dead trees with me much anymore. At the bedside is Aspirin & Nye’s Myth Alliances, which I’ve apparently had on the shelf for a good long time, and somehow never managed to pick up before. And on the Kindle (also bedside reading) is Joseph Lallo’s Unstable Prototypes. Plus I’ve got a stack of IEEE, ACM, USENIX ;login:, and woodworking magazines to get through one of these days.

*      *      *

Our condolences to the families, friends, and units of these fallen warriors:

  • Sgt. 1st Class Ramon S. Morris, 37, of New York, New York, died Dec. 12, in Parwan Province, Afghanistan, of wounds suffered when the enemy attacked his vehicle with an improvised explosive device.
  • Spc. Wyatt J. Martin, 22, of Mesa, Arizona, died Dec. 12, in Parwan Province, Afghanistan, of wounds suffered when the enemy attacked his vehicle with an improvised explosive device.

 

“A date which will live in infamy”

So said Franklin Delano Roosevelt, President of the United States of America, after the attack at Pearl Harbor by the Japanese. Here is a transcript of his speech, courtesy of GMU. This important historical even seems barely mentioned by big media these days. I was pleased to see that the flags in Maryland are at half staff today to honor those who died in the attack.

*      *      *

Along with finishing up Marcia’s quilting cabinet (see the December 4 post), and getting some house cleaning done, I managed to spend some time working on building a sump pit monitor using the code and recommended hardware from Al Audet’s Raspi-Sump webpage. This useful project came to my attention via the October issue of Linux Journal.

It’s also good fun to find something properly useful to do with my version 1 Raspberry Pi Model B. I recently got a Model B+, so I’m going to have to do something with that, too.

I poked at the project for a while, and geared up a bit for some electronics work (which I’ve not done for a long damn time). This evening, I got it working, and finally grokked the fiddly bits of the config file, which uses the word “distance”, when the word “depth” would be much more useful. I’m also going to rig up a water sensor as a backup: once the sump failed by pumping the water out of the pit, but not out of the house. Yup, a water sensor would be good thing.

But next, I’ll start monitoring to get a sense of how the water ebbs and flows, so that I can tune the variables in the config file properly. I’ve also still got to configure the alerting system.

*      *      *

Our condolences to the families, friends and units of these fallen warriors:

  • Capt. William H. DuBois, 30, of New Castle, Colorado, died on Dec. 1 when his F-16 aircraft crashed near a coalition air base in the Middle East.
  • Staff Sgt. Matthew R. Ammerman, 29, of Noblesville, Indiana, died on Dec. 3, in Zabul Province, Afghanistan, of wounds suffered from small arms fire while conducting a clearing operation.

Jet Lagged in Seattle

That was me. The first five mornings of my seven odd days at LISA’14 in Seattle started between 0400 and 0430 in the morning, as my body insisted it was time to rise and shine. The most fun, though, was the wake-up due to SMS, when our garage door failed to open for Marcia. Turns out the spring catastrophically unsprung itself overnight Sunday night (though Marcia couldn’t figure out the source of that noise until morning). Fortunately, “catastrophically” didn’t include damage to either house or cars. She consulted, then called Overhead Door, who came out and made it all better, for money. Well spent, that.

*      *      *

The LISA conference was useful, educational, and fun.

On Sunday, I partook of two half-day tutorials: Statistics for Ops: Making Sense Out of Data (presented by Kyrre Begnum and Nicole Forsgren Velasquez); and R for Sysadmins (presented  by Jason Maughan and Nicole Forsgren Velasquez). R is a language/environment for statistical computing and visualization. In a nutshell, Sunday was Math Day. And it’s surprising how much more interesting statistics are when I care about the data and results. Using the vast amounts of machine-generated data I collect, I can use freely available tools to baseline and model the behavior of my systems and infrastructure. Why? To catch out-of-the-ordinary trends before they become problems, of course. These two classes also helped me to understand the underpinnings of the other tools that we utilize for monitoring at $FIRM. And, since my goal for LISA is always to spend my time hanging out with and learning from people smarter than I am, it was a very good first day, indeed.

I would have spent more time in the evening sessions, formal and informal, as well as the late-day “hallway track”, but my body for the first three days was done by eight or so in the evening. I’d hang out in the freenode #lisa14 IRC channel, have a bite of supper, and fall asleep in the bedside chair, with the TV running. Party animal, I’m not.

On Monday, I sat in on a full-day training on the topic of Testing Your Automation Code, presented by Nathen Harvey. While Nathen works for Chef, and I use another automation suite for my environment, the principles of test-driven development for operations management are sound and cross the boundaries I need them to cross. I’m learning to be more effective with the tools I’ve chosen, and this training gave me better leverage for planning, execution, and documentation.

Tuesday I was absorbed in the Defending Against the Dark Arts tutorial offered by Branson Matheson. I’ve taken training from Branson previously – he’s primarily a computer and operational security bloke, but with strong cred across a lot of the fields that comprise modern enterprise information technology. This was a first-time-offered course by Branson, which discussed how well-funded offensive actors are driving into and through most organizations. Topics included how to offer organizational training to oppose trivial social engineering attacks, and how to focus on the layered defenses in a manner so as to shorten the time between a successful attack, and the detection thereof. Since the bad guys generally always have access to a successful attack against a vulnerability before there’s a chance (or even a hope) of patching, it’s better to detect and mitigate their presence as quickly as possible as a primary goal. It was an excellent and stimulating day.

That’s the quick survey of my three training days of LISA 14. As a result, I didn’t get to attend any of the other 18 full- and half-day courses offered during the same time span. Sigh. I guess there’s always next year. And this holds doubly true for the second three days of the conference: Talks (vendor and invited), refereed papers, mini-Tutorials, and more: Oh My! The fun kept happening…

Wenesday opened with remarks by Program Chair Nicole  Forsgren Velasquez (you’ll recognize her name from my stats trainings on Sunday). Nicole welcomed us to the more academic (and more crowded) half of LISA14. Attendance is up quite a bit: 1100+ this year. She was followed by opening keynoter Ken Patchett of Facebook, who talked to us about Open Compute and the Changing Data Center. Very interesting stuff, especially (mostly?) to the two or three dozen companies that deploy systems at those scales. Fun to learn about, but way beyond what I can apply in my environment.

Other things I sat in on Wednesday: H. Wade Minter presenting, “You code like a SysAdmin” – on the importance of coding for ops. Dave Cliffe on the topic of “Best Practices when the s*IT hits the fan.” – planning and rehearsing for the inevitable outages. Lunch was spent with the vendors on the expo floor. Caskey Dickson discussing “while (true) do; How hard can it be to keep running” – resilience at the service layer. “LISA Build: Mind. Blown” was presented by Branson Matheson and the rest of the volunteer LISA Build team, who assembled and kept the conference network going for the entire 6 days. Wednesday’s talks wound up with Lars Lehtonen, on the toopic of “Burnout and Ops.”

Thursday’s keynote was by Gene Kim, entitled “DevOps Patterns Distilled: A Fifteen Year Study of High Performing IT Organizations.” Gene is well know in IT circles for a variety of commercial and academic reasons. He talked to us about what makes the best performing IT organizations distinctive. There’s a paper coming (not out yet) that should substantiate much of what he discussed. The rest of my Thursday included: Steven Murawski on “Building PowerShell Commands.” An hour or so sitting at the LOPSA table supporting our community. Finally, Steven Murawski again, on the topic of Windows Desired State Configuration.

On Friday, the talks I sat in on included: Chris Stankaitis on the utility of checklists to enhance human reliability. Ben Rockwood: “I am SysAdmin (and so can you).” Luca Deri describing “High Speed Network Monitoring using ntopng.” Brendon Gregg speaking on Linux Performance Analysis. The capstone of the week was delivered by Courtney Kissler, VP of eCommerce and Store Technologies at Nordstrom. Her conference-closing keynote was an enlightening look at what a large, non-technology firm makes of, and utilizes, from the buzzword-drenched ever-shifting technology sands that our industry is today. Three thumbs up for Courtney!

There were many other events, too: An evening social sponsored by Cambridge Computers that was very pleasant. A conference party at Seattle’s EMP Museum (not Electro-Magnetic Pulse, much to my surprise). Music and art and sci fi and fantasy and horror all in a yummy mix there, in the shadow of the Space Needle. The famed hallway track, where unscheduled and awesome conversations happen nearly around the clock.

It was a superb, if hugely tiring, week of smart people sharing their knowledge and wisdom. I loved it.

*      *      *

Now it’s time to utilize some automation tools to do some Linux patching. Be well.

Post, pending

I got back from attending LISA 14 – the six day, annual, USENIX Large Infrastructure Systems Administration conference – in Seattle late last night. I’ve not had time to compose my trip report, but I wanted to check in and say, “Hey, y’all.”

I’ll be back in a few days with more to report. I’m back on call, and quite tired. Oh, yeah: tomorrow’s wake-up time is at 0300 as far as my body clock is concerned. Go, me.

*      *      *

Our condolences to the family and friends of Sgt. 1st Class Michael A. Cathcart, 31, of Bay City, Michigan, who died on Nov. 14, in Kunduz Province, Afghanistan, of wounds received from small arms fire while on dismounted combat operations.

Space, Patch, Read

A number of folks who lack a sense of wonder, a sense of adventure, a … spine, perhaps, are whinging in articles here and there online about how awful it is that Michael Tyner Alsbury died testing a near-space tourist plane. How very risk-averse we’ve become, as a culture. I’d do his job tomorrow, in  a heartbeat, if they’d let me. The wonder and joy of experimentation, research at the edges of what’s possible make life worth living, either personally or vicariously (for those of us too old to but dream). Again, risk vs. reward.

*      *      *

Today I finished patching the rest of my Solaris systems. That’s a good thing, and it came off without a hitch, nothing but the 3 hours of time invested, and I was able to accomplish other tasks while monitoring the patch, live update activation, and reboot processes in other windows. Not the life of Riley, but it’s the one I have.

I should have gotten to mowing the lawns and roasting some coffee, but that didn’t happen, so I’m going to have to squeeze those in during the week ahead.

*      *      *

Recent Reading

I finished reading Cheri Priest’s Dreadful Skin this week. Jack is a changed man. Well, a man changed into … something. Avoiding spoilers when discussing stories like this is hard.

Some of the joy of reading Cherie Priest’s wondrously intense writing is the little surprises in the beginnings that set the mood and reveal bits of joy (and horror). As in a well-done horror film, you can tell from cinematography and music that something scary and terrible is about to happen, but you can’t tell what until it jumps out at you from the shadows. Ms. Priest manages that time and again with her writing. I’ve not read the whole of the Priest canon extant, but so much that I have read contains that power to surprise and delight, even in the darkest of places.

I enjoyed this triptych tale, and when you read it (as you should), I hope that you do too. Note – this is probably not for most of the YA and younger crowd. That said, I’d have probably read it by age 10 or 11 without harm. Highly recommended.

I also finally finished up reading Clarkesworld Magazine, Issue 97. My favorite of the fiction therein was Taxidermist in the Underworld, a grim tale with a twisty happy ending. I can recommend Clarkesworld Magazine without hesitation or reservation – I’ve been a subscriber (at a very reasonable price, mind you) for the last couple of years.

In progress: I’m still reading Paolo Bacigalupi’s The Doubt Factory. I’m finding it harder to get into than I’d hoped. But early impressions are rarely reliable, so I’ll forebear any judgement until I’m done. That’ll be a while, because unless I’m mistaken, I’ll not be through before I leave the book behind for a week while I’m at LISA’14 in Seattle.

On deck: Clarkesworld Magazine, Issue 98.

*      *      *

Our condolences to the family and friends of Cpl. Jordan L. Spears, 21, of Memphis, Indiana, who was lost at sea on Oct. 1* while conducting flight operations in the North Arabian Gulf.

[* DoD says “previously reported”, but I haven’t seen Corporal Spears mentioned in the DoD timeline]