Site Sponsors:
Linux Disk Dump (35MB/Sec) 
Last week I noticed that my main drive was showing some classic boot-up warning signs. Rather than risk another 4 hour re-install session (followed by an 6 hour content restoration), we decided to get a 2T Toshiba backup drive.

It arrive skewed. After checking around, lots of my friends at the local computer repair places were saying that the Toshiba Drives have even worse failure rates than Western Digital. (So much for saving $20!)

So it was back to the Internet to get yet another 2T Seagate Barracuda: Tried and true, the 7200 RPM drive is well worth an extra $20.oo (lol.) -Better still, by matching the existing drive our confidence factor was absolute for an anticipated manual swap-out.

DeeDee


After well under 20 hours (was out Christmas shopping when the `dd` completed), the note to self is to use the POSIX `time` command next time around.

More officially however, here are the stats for the disk-dumping of 2TBs worth of data between two "identical" hard drives:

dd if=/dev/sda of=/dev/sdb
3907029168+0 records in
3907029168+0 records out
2000398934016 bytes (2.0 TB) copied, 57876.7 s, 34.6 MB/s

(Yea, sounds a bit off to me, too. -But we were running both live & hot.)

Regardless, the next time I Dee-Dee this locus, we might update this entry with the actual `time` (man time) results. Yet for now there is enough info in the above (round to 35MB/Sec - we were not that hot) for others to do the math to support their own `dd` ops.

Cheers!

-Rn


[ view entry ] ( 1687 views )   |  permalink  |  related link
F-Word: Our Greatest Happiness? 
Linked-in: HELP! I Got Blamed for my Co-Worker's Mistake

Life is a long song. I like to remember that success is not Final; Failure, seldom Fatal.

Through it all, I try to remember that peace is only obtainable by remembering another F-word. (No, not THAT one ...;)

The happiest folks we will ever meet have always learned how to both grant, as well as to get "Forgiveness" :)

[ view entry ] ( 1336 views )   |  permalink  |  related link
HUE File Browser Exception / Error 
Those who are using HUE on the HDP 2 (and probably elsewhere) will - from time to time - see the annoying "Error 113 - No route to host" Exception:

WebHdfsException at /filebrowser/

<urlopen error [Errno 113] No route to host>

Request Method: GET
Request URL: http://192.111.1.237:8000/filebrowser/
Django Version: 1.2.3
Exception Type: WebHdfsException
Exception Value:

<urlopen error [Errno 113] No route to host>

Exception Location: /usr/lib/hue/desktop/libs/hadoop/src/hadoop/fs/webhdfs.py in _stats, line 209
Python Executable: /usr/bin/python2.6
Python Version: 2.6.6
Python Path: ['', '/usr/lib/hue/build/env/lib/python2.6/site-packages/setuptools-0.6c11-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/pip-0.6.3-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/Babel-0.9.6-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/BabelDjango-0.2.2-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/Django-1.2.3-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/Mako-0.7.2-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/Markdown-2.0.3-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/MarkupSafe-0.9.3-py2.6-linux-x86_64.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/MySQL_python-1.2.3c1-py2.6-linux-x86_64.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/Paste-1.7.2-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/PyYAML-3.09-py2.6-linux-x86_64.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/Pygments-1.3.1-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/South-0.7-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/Spawning-0.9.6-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/avro-1.5.0-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/configobj-4.6.0-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/django_auth_ldap-1.0.7-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/django_extensions-0.5-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/django_nose-0.5-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/elementtree-1.2.6_20050316-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/enum-0.4.4-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/eventlet-0.9.14-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/greenlet-0.3.1-py2.6-linux-x86_64.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/happybase-0.6-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/kerberos-1.1.1-py2.6-linux-x86_64.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/lockfile-0.8-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/lxml-2.2.2-py2.6-linux-x86_64.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/moxy-1.0.0-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/pam-0.1.3-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/pyOpenSSL-0.13-py2.6-linux-x86_64.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/pycrypto-2.6-py2.6-linux-x86_64.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/pysqlite-2.5.5-py2.6-linux-x86_64.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/python_daemon-1.5.1-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/python_ldap-2.3.13-py2.6-linux-x86_64.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/pytidylib-0.2.1-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/sasl-0.1.1-py2.6-linux-x86_64.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/sh-1.08-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/simplejson-2.0.9-py2.6-linux-x86_64.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/threadframe-0.2-py2.6-linux-x86_64.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/thrift-0.9.0-py2.6-linux-x86_64.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/urllib2_kerberos-0.1.6-py2.6.egg', '/usr/lib/hue/build/env/lib/python2.6/site-packages/xlrd-0.9.0-py2.6.egg', '/usr/lib/hue/desktop/core/src', '/usr/lib/hue/desktop/libs/hadoop/src', '/usr/lib/hue/desktop/libs/liboozie/src', '/usr/lib/hue/build/env/lib/python2.6/site-packages', '/usr/lib/hue/apps/about/src', '/usr/lib/hue/apps/beeswax/src', '/usr/lib/hue/apps/filebrowser/src', '/usr/lib/hue/apps/hcatalog/src', '/usr/lib/hue/apps/help/src', '/usr/lib/hue/apps/jobbrowser/src', '/usr/lib/hue/apps/jobsub/src', '/usr/lib/hue/apps/oozie/src', '/usr/lib/hue/apps/pig/src', '/usr/lib/hue/apps/proxy/src', '/usr/lib/hue/apps/shell/src', '/usr/lib/hue/apps/useradmin/src', '/usr/lib/hue/build/env/bin', '/usr/lib64/python2.6', '/usr/lib64/python2.6/plat-linux2', '/usr/lib64/python2.6/lib-dynload', '/usr/lib64/python2.6/site-packages', '/usr/lib/python2.6/site-packages', '/usr/lib/python2.6/site-packages/setuptools-0.6c11-py2.6.egg-info', '/usr/lib/hue/apps/beeswax/gen-py', '/usr/lib/hue', '/usr/lib64/python26.zip', '/usr/lib64/python2.6/lib-tk', '/usr/lib64/python2.6/lib-old', '/usr/lib/python2.6/site-packages/setuptools-0.6c11-py2.6.egg-info', '/usr/lib/python2.6/site-packages/setuptools-0.6c11-py2.6.egg-info', '/usr/lib/hue/apps/beeswax/src/beeswax/../../gen-py', '/usr/lib/hue/apps/jobbrowser/src/jobbrowser/../../gen-py', '/usr/lib/hue/apps/proxy/src/proxy/../../gen-py']
Server time: Sat, 14 Dec 2013 01:23:12 -0800

While disconcerting, rest assured that there is nothing wrong with your VM. This is a connectivity thing!



Repeat: Until a fix is available for this buglet, there is no need to re-install your VM! (You might, however, want to bump-up your VM response time by manually cranking-up the processor speed on the VM Host.)

Environment:

Request Method: GET
Request URL: http://192.111.1.237:8000/filebrowser/
Django Version: 1.2.3
Python Version: 2.6.6
Installed Applications:
['django.contrib.auth',
'django.contrib.contenttypes',
'django.contrib.sessions',
'django.contrib.sites',
'django.contrib.admin',
'django_extensions',
'south',
'babeldjango',
'desktop',
'about',
'beeswax',
'filebrowser',
'hcatalog',
'help',
'jobbrowser',
'jobsub',
'oozie',
'pig',
'proxy',
'shell',
'useradmin']
Installed Middleware:
['desktop.middleware.DatabaseLoggingMiddleware',
'django.middleware.csrf.CsrfViewMiddleware',
'django.middleware.common.CommonMiddleware',
'desktop.middleware.SessionOverPostMiddleware',
'django.contrib.sessions.middleware.SessionMiddleware',
'django.contrib.auth.middleware.AuthenticationMiddleware',
'desktop.middleware.SpnegoMiddleware',
'desktop.middleware.HueRemoteUserMiddleware',
'django.middleware.locale.LocaleMiddleware',
'babeldjango.middleware.LocaleMiddleware',
'desktop.middleware.AjaxMiddleware',
'desktop.middleware.LoginAndPermissionMiddleware',
'django.contrib.messages.middleware.MessageMiddleware',
'desktop.middleware.NotificationMiddleware',
'desktop.middleware.JFrameMiddleware',
'desktop.middleware.ExceptionMiddleware',
'desktop.middleware.ClusterMiddleware',
'desktop.middleware.AppSpecificMiddleware',
'django.middleware.transaction.TransactionMiddleware',
'desktop.middleware.XFrameOptionsMiddleware']


Traceback:
File "/usr/lib/hue/build/env/lib/python2.6/site-packages/Django-1.2.3-py2.6.egg/django/core/handlers/base.py" in get_response
100. response = callback(request, *callback_args, **callback_kwargs)
File "/usr/lib/hue/apps/filebrowser/src/filebrowser/views.py" in index
91. if not request.fs.isdir(path):
File "/usr/lib/hue/desktop/libs/hadoop/src/hadoop/fs/webhdfs.py" in isdir
224. sb = self._stats(path)
File "/usr/lib/hue/desktop/libs/hadoop/src/hadoop/fs/webhdfs.py" in _stats
209. raise ex

Exception Type: WebHdfsException at /filebrowser/
Exception Value: <urlopen error [Errno 113] No route to host>

Whenever we see a Error 113, what needs to happen is a simple re-start.

Restarting the Sandbox


To clear the problem we need to:

(1) Close all browser windows, as well as browser sessions (important!)

(2) Re-start the VM.



NOTE: To re-start your Sandbox properly, simply log into the OS as root via the main HDP console so as to enter shutdown -r 0 at the main console prompt.

(No, shutdown will not blink like that - Except maybe around Christmas ;oP )

The Unix / Linux Manual


For more information on the Shutdown command (or just about any other common command utility), the next time you are at the Console enter man shutdown, where 'man' is the mnemonic for manual, and shutdown can be replaced with any other command you might be interested in (for example, man tar, man bash, or even man man :)


Obvious pun??


If things scroll too fast, try:

man shutdown | more


[ view entry ] ( 1318 views )   |  permalink

<<First <Back | 43 | 44 | 45 | 46 | 47 | 48 | 49 | 50 | 51 | 52 | Next> Last>>