Posts filed under ‘Storage’

UnRAID experiences

Recently, NewEgg had a deal on an HP ML10 V2 server for about $170 after rebate.  It included an i3 processor at 3.5 Ghz, a 500 GB hard drive, and 8 GB of ECC ram.  I had a hard time passing up that good of a deal, so I didn’t.

After playing with VMware ESXi 6.5 on it for a bit, I decided to try UnRAID.  I was interested in using Docker on it, something I have dabbled with on my Synology.

Having used UnRaid for more than a week, I think I’m about ready to get rid of my NAS and use this instead.

The initial setup was easy.  I loaded the software on a USB drive, put several low capacity drives in it (largest being 1 TB) and created the array using the web interface.  It began the parity process and I started setting up shares and using it.

Let me explain a bit about how UnRAID works.  It’s not your traditional RAID array.  You basically put in whatever disks you want, select the largest one as the Parity drive, and start using your array (there are some WebGUI steps involved, but it’s very easy).  I understand that you can even take drives that already have data on them (in a format UnRAID uses), and that data is preserved, with the exception of the parity drive.  With UnRAID, you get the advantage of parity protection, so if a single disk dies, just replace it and it rebuilds.  If there’s a problem with more than one of your disks at once, you only lose data on the failed drives.  Your remaining working drives have all their data intact.

Another differences is the way shares work.  It has your traditional disk based shares, where you add a share for an individual disk, and write files to it the usual way, and it will create parity info on the parity drive should that disk fail, so your data is safe….  And it has what it calls “user” shares.  These shares span your disks.  So, you might have a media share, for example.  You copy a video over to it, which gets dropped on disk 1.  Later, you copy another video, and it gets dropped onto disk 2.  When you view directory listing of the share, though, you see a single view with all the files presented as if they were in a single structured set of folders, so you don’t have to know which disk a specific file is on…  UnRAID tracks that for you and presents it all as if it’s a single, large share.

Anyhow, over the next few days, I set up three Time Machine shares, along with a couple others and copied over the majority of the data from my NAS to it.  (I have not been storing nearly as much on my NAS recently, having cleaned off tons of media some time ago.)

The Docker container functionality is great.  You can load a docker container based on templates, so there’s not much to do but point and click, though you may have to type in a path or two, here or there.  Think of it sort of as Plug-ins or Apps – there’s a Plex container, MythTV, SageTV, and many, many more.

After the initial parity calculation was done, I moved my 4TB drive from my NAS over, replacing the parity drive in UnRAID.  It rebuilt the parity info after I adjusted the config in the WebGUI.  Then, I proceeded to swap another drive with a 3 TB drive, and let it rebuild that., and I’ve done that with yet another 3 TB drive.  At this point, only one of the original hard drives is in the array.

And, I actually want to remove that last 750GB drive from the array.  With traditional RAID, that’s pretty much a no-go.  With Synology’s hybrid RAID, or a Drobo’s approach to RAID, I think you have to stay with the same number of disks in the array, short of copying all the data off and recreating the array fresh with fewer disks.

With UnRAID, though, I’m now copying all the data from disk 3 to disk 2 using a simple rsync command.  Afterwards, according to what I’ve read, I can simply remove the disk, then create a new array with one less disk and it will recreate the parity information.

Why would I want to do this, you may wonder?  To add a cache drive.  UnRAID lets you add a cache drive (an SSD, or perhaps just a 10K RPM or 7200 RPM drive), and set up your shares to take advantage of the cache drive.  When data is written, it goes to the cache drive, and at 3:40 AM, data is moved off the cache drive to the other drives in the array, at which time parity info is calculated.

Now, if you run a business and keep critical data on UnRAID, you shouldn’t entrust the safety of your data to a single cache drive, as the parity info associated with the cache drive is only generated once per day, so there is the potential to lose whatever data has been written to the cache drive.  But if you are a home user, mainly using it for entertainment purposes, you can probably take the chance, for the performance improvement (especially with an SSD cache drive).

Although I’m still within my first 30 days of using UnRAID, it’s safe to say I’ll be buying it soon.

Advertisements

April 25, 2017 at 8:55 pm Leave a comment

MythTV on a Synology NAS

I have a DiskStation 1512+, which has an Atom D2700 CPU with two cores running at 2.13 Ghz and 3 GB of RAM.  While it’s not speedy by today’s standards, DSM is easy to use and includes the ability to do a lot with a few mouse clicks, including run Docker, which in itself gives you a lot of flexibility.  I also have an HDHomerun Prime tuner, which would seem to be a good match for MythTV, if I could get it running on this NAS.

I’ve looked into running MythTV on Docker in the past.  Searching around the net, I’ve found people talking about it, and there are even some Docker images available for MythTV, but documentation hasn’t exactly been a strong point.  There is an image for Unraid of an older version of MythTV, but I wanted to use .28.  Fortunately, someone made a newer container with that version!  It works on a Synology, if installed correctly…  With a few caveats.  And since I had trouble finding good instructions on getting this to work on a Synology NAS, I thought I would post it here for anyone else who wants to try this.

My Installation
1. DSM 6.1-15047
2. Docker 1.11.2-0316 installed via Package Center

To Install

  1. Login to DSM and start Docker
  2. Go to the Registry and search for MythTV
  3. Download mp54u/myth28:latest
  4. When done, to the the Image section, click on the image and hit the Launch button
  5. In the Create Container window that pops up, hit the Advanced Settings button
  6. Click on the Network tab, then check the box Use the same network as Docker Host
  7. On the Volume tab, create three mount paths:
    1. Create/Select /media/MythTV and set the path to /home/mythtv
    2. Create/Select /media/MythTV/recordings and set the path to /var/lib/mythtv
    3. Create/Select /media/MythTV/db and set the path to /db
  8. On the Environment tab, add a variable called TZ and set the value to  the appropriate timezone.  In my case, this was America/New_York.  There should be no spaces in the name here.  Google for Linux and TimeZones and you’ll probably be able to find a list of them.  Make sure to use the right one.
  9. Launch your new MythTV container.  Give it a couple minutes before continuing.
  10. Open a VNC client.  Put in your DiskStation’s IP, and remote control it.
  11. You should be logged into your Docker now.

Note:  The username and password are both mythtv.

At this point, you should be able to run the MythTV Backend Setup tool and configure MythTV.  After it’s configured, MythWeb will be running on your DiskStation, port 6760.

This forum post, which is a little specific to Unraid and involves the older docker image with MythTV .25 or so, should help you set it up past this point.  Note – He talks about using RDP to control it, but that did not seem to work when using Host networking, but VNC did from my Mac (using Chicken of the VNC).  Be aware that I have had issues exiting from the MythTV Backend Setup tool where VNC seems to lock up.  I’ve had another time where it exited normally, but the Backend didn’t seem to start afterward.  In both cases, a quick restart of the Docker container got it back up and running again.  If anyone comes across these issues and figures out a good long term fix, please leave it in the comments!

Front End
In my opinion, about the best front end that will run on a set top box is MrMC.  It’s available for AppleTV and for FireTV and is pretty inexpensive.  It includes the MythTV PVR add-on and is easy to configure, especially if you have experience with Kodi.

February 28, 2017 at 11:33 pm 2 comments

HP N54L is on the way

I am in the process of acquiring a used HP N54L N40L.  If you don’t know, this is a microserver.  They are extremely small machines that have room for 4 swappable hard drives, and maybe two more without adding any more cards.  I heard about it a year or more ago and considered buying one for myself, but ultimately my budget decided I couldn’t afford it.

What changed?  Well, this machine was a gift, so the budget isn’t a factor.  Since I found out it was coming my way, I have been looking around the web to find out the best thing to do with it.  It didn’t take long before I ran across pages talking about installing ESXi 5.5 (there is an ESX image for it put out by HP!)  Since there is a supported version of ESXi floating around, it’s liable to be very stable.  Further, from what I’ve read, the processor in this unit isn’t really that bad.  A quick check shows that it’s a little shy of twice as fast as the processor in my Synology 1512+ NAS.

Speaking of the NAS, some of the tutorials I’ve found tell you how to install Synology’s OS on a VM, then point it to your individual raw disks.  If this works as well as I suspect it might, I could end up with the advantages of Synology OS running in a VM, but still keep the advantage of the physical write speeds as if it were running natively.  I could also have a couple of other VMs running at the same time (not doing any hard number crunching).

I”m not 100% sure what I’m going to do yet, but I’m working on the plans.

Update:  The server arrived, and it was actually the older version, the HP N40L, not the N54L.  So, the processor speed is 1.5 Ghz, instead of the 2.2 Ghz I was expecting.  Other than that, it’s the same, really.  It’s got a lot less processing power than I expected, but I think it’s still a potentially very useful box.  Considering that it was given to me at no cost, I can’t complain too much about the mix-up.

August 15, 2014 at 11:40 pm Leave a comment

Synology DSM 5.0 is out, meh…

Back on March 10th, Synology released DSM 5.0 to the world, post-beta.

I’ve been running it now for about two weeks, and I’m fairly happy with it.  There were no issues with upgrading to it from 4.3, and even installing 5.0 Update 1 a few days after the initial 5.0 upgrade went very smoothly.  It’s been just as stable with the 5.0 as it had been under 4.3, which is to say VERY.

First off, the main feature you’ll notice is the new coat of paint.  They already had the most advanced UI for a NAS on the market, but they’ve been pushing the boundaries anyhow.  The icons are now more colorful and generally simpler in design.  Really, it looks like they gave DSM the IOS 7 treatment.  It appears the devs are moving toward the Mac style, right down to the Launchpad look-a-like that shows up each time you hit the equivalent of the Start button.  Good news if you have tablets at home, the UI is now touch-capable.

For small businesses, the new DSM supports a central management tool allowing you to see all your NAS devices in a single app.  Haven’t tested that, as I only have one Synology NAS, but this sounds like a great new feature for small businesses that have multiple NAS devices.

Cloud Sync is a new feature allowing you to sync your Google Drive, Drop Box (and perhaps other) storage accounts with your NAS natively.

From a functionality standpoint, they claim to have sped up the performance of both AFP and SMB file transfers. Oh, and if iSCSI is your thing, they claim it is up to 6 times faster.

Personally, I’m not very excited about this new upgrade.  Yes, the speed enhancements are very nice, but most of the new features weren’t really aimed at users like me.  The new UI was really unneeded at this point, either, since it was already better than anything else you can get in a NAS.

What would I have rather seen?  It may be boring to the people at Synology, but more high-quality apps.  Work with the third parties out there to make all the apps on Synology devices better.  For example, I understand the built-in video station does some hardware assisted transcoding.  It would be awesome if they would give specs to the Plex guys on how they could incorporate that into Plex also.  If they did that, perhaps I wouldn’t have moved Plex from my Diskstation to my Mac Mini (my main workstation).

April 2, 2014 at 10:30 pm Leave a comment

New Samsung 840 EVO SSD install in 2011 Mac Mini

My recent post recounted the problems that I’ve had since doing my own DIY Fusion drive installation.  Basically, it sounds like my 500 GB drive was starting to die, even though running a SMART test against it showed everything was great.  The clicking I heard on boot-up definitely sounded mechanical, and since the only two mechanical things in the Mini are the system fan and the hard drive, I think the hard drive is the safer bet as the source of the problem.

I ordered a Samsung 840 EVO 500 GB SSD on Saturday.  It was scheduled to arrive sometime today, so I made sure to have a recent backup via Time Machine and via SuperDuper! (to an external drive).  Once that was complete, I shut down the Mini and proceeded to disassemble it.  It arrived around 5 PM and I set off to installing it.

If you’ve never opened up the DVD-less Mac Mini, I’ll say it’s not for the faint of heart.  Today, I removed both the original hard drive and the 128 GB Crucial m4 drive that had been running as a fused pair.  I have serious doubts about the HDD, but I expect that I’ll reinstall the 128 GB SSD in a machine my kids use for homework and such.

The installation of the Samsung 840 EVO went very well.  The most difficult part was getting it aligned with the two holes in the carrier.  Perhaps I should have done that with the carrier outside of the chassis.  One of the two screws that goes through the perforated aluminum plate wouldn’t reach the SSD hole.  Not wanting to dissemble things again, I let that one minor flaw in place and completed the assembly.

I had previously created an 8 GB flash drive to make re-installing OS X 10.9 easier, so I went that route.  The SSD was seen by disk utility, I formatted it, and then installation went without incident.  After it rebooted, it prompted me to restore.  I selected Time Machine, put in the password to pull the Time Machine Backups off of my NAS, and let it start restoring.  Here, OS X had all sorts of difficulty figuring out how long it would take to completely restore everything.  It might show 51 minutes, or 4 hours.  The restore process actually took more like 2 1/2 hours.

Now, I’m back up and running with 10.9 installed on a 500 GB SSD, with about 370 GB of it in use.

My Mini is now significantly faster than with the Fusion drive.  Don’t get me wrong, the Fusion drive was faster than the HDD alone, but the SSD alone is so much better than the Fusion drive.

The 840 EVO is among the fastest consumer SSD drives available now, at a great price point.  I wasn’t too keen on the 840 series when I read it uses the cheaper TLC.  Not only does it allow for fewer writes than SLC, it’s slower doing those writes.  This means it should be less reliable and perform worse, a bad combination if there ever was one.  However, the EVO version pairs the TLC with a SLC cache of sorts, so you can perform faster writes.  And Samsung’s reliability of the 840 hasn’t been bad at all.  According to what I’ve read, I’m expecting this new SSD to last 15 years or more.

My mini has had new life breathed into it.  Moving from a Hard Drive to a SSD is truly one of the best upgrades you can do yourself.

October 29, 2013 at 11:02 pm 6 comments

My DIY Fusion drive under 10.8.3

I finally installed 10.8.3 tonight after ensuring that my SuperDuper clone was up-to-date.  I’ve been avoiding it a little, just in case there are issues with my DIY Fusion drive.

The upgrade went smoothly, and soon I was sitting back at my normal login screen.

After the install, I checked things out, relative to my DIY Fusion drive.  To refresh everyone’s memory, I have the 500 GB Toshiba HD that came with my 2011 Mac mini, “fused” with a 128 GB Crucial M4 SSD.

The Storage tab under “About This Mac” recognizes it as a 628 GB “Fusion Drive”.  That’s a good start…

Disk Utility shows my Fusion drive as a Logical Volume Group.  It shows the capacity as 626.94 GB, with 621.51 GB used and 5.43 GB free.  Below that in the Disk Utility window is the actual partition that my files reside on, which shows a capacity of 614.48 GB, with 352.78 GB used.  These numbers are in agreement with the “About This Mac” numbers.  This looks pretty good too.

Interestingly, if I go to the Partition tab when my Logical Volume Group is selected, it shows one partition of 499.25 GB…  Which looks to me like numbers related to the actual size of my Mini’s hard drive.  This doesn’t look like I would have expected.

Next, I took a closer look at System Information.  There I noticed that TRIM wasn’t enabled, so I ran Trim Enabler and turned it on.  After a reboot, Trim Enabler reports that it’s working, so I guess that’s one thing I’ll probably have to do every time there’s an OS update.

Overall, it looks like things are pretty safe in this release, but everything still doesn’t line up 100%.  I imagine that by the time I’m in the market for a replacement Mac (2014?  2015?), the mid-level Mini will probably come with SSDs standard, so I probably won’t need to “roll my own” Fusion drive again… But you never know!

April 5, 2013 at 9:38 pm Leave a comment

Synology DSM 4.2 is out! Radius Alert!

DSM version 4.1 has been my standard since I got my Diskstation sometime last summer.  Today, I happened to check and found that version 4.2 is now available.

NOTE:  Right now there is a screaming good deal on a 3TB WD Red drive at NewEgg ($139).  Check out hotdealsclub.com for the coupon code.  I ordered one minutes after seeing the price, as that’s a very good buy on this drive, which NewEgg normally sells for $179.

Anyhow, I installed DSM 4.2 not expecting much, with it being a point upgrade.  Looking around at it though, I’m surprised, and in a good way!

The first thing I noticed was that the GUI for the Package Center is different.

The second thing I noticed was that there were a bunch of new packages that look really good.

DHCP Server
I remember this being a feature of 4.1, but I believe it was lacking reservations.  They are supported now, along with screen to show you the current leases, plus you can do multiple scopes now.
DNS Server
I’ve wanted a decent DNS server for my NAS, and now I’ve got one.  It’s got a nice GUI interface for setting up zones, and it seems pretty fast.  Not sure whats under the hood, but I’m using it as mine now.
Radius Server
This was a surprise, and it’s the Gem of the upgrade, in my opinion.  It’s got a deceptively simple GUI.   It was nice to see that it comes out-of-the-box with options to authenticate local users, LDAP users, or Domain users (the only options on the Settings panel).  The Clients panel allows you to add clients… I added a quick client (a newly created SSID on my OpenWRT box), set the Shared secret, and Applied it.   It’s got a Block List panel, which appears to allow you to set certain users (or groups) that you wish NOT to be authenticated.  Lastly, it has a Log panel, which lets you see what it’s been up to.

Perhaps most surprising of all, my simple test worked with very little effort.  I connected to my new WPA2 Enterprise SSID via my iPhone, and it prompted me to accept the Certificate, put in my new username and password, and it authenticated.  My iPhone was connected and working.  I may just move all of my Enterprise Auth to the Radius server on my Diskstation, if it proves to work well.

Other new features that I’ve only looked at briefly, but look good:Antivirus by McAfee – Not saying this is a good thing, but more A/V options aren’t really bad.
Syslog Server – Nice looking GUI interface.  It’s not Splunk, but it’s decent.
Directory Server – Was this in 4.1?  I plan to check into this one when I have some time…

There are lots more packages, that look to be useful in a business setting as well.

I’ve already turned off DHCP for my router and started using this as my caching DNS server.  Perhaps this weekend, I’ll move my “main” SSID over to let my DiskStation handle the Radius auth as well.

March 14, 2013 at 12:06 am 1 comment

Older Posts


Calendar

September 2017
S M T W T F S
« May    
 12
3456789
10111213141516
17181920212223
24252627282930

Posts by Month

Posts by Category