bloxHub

www.infoblox.com/community
20 posts / 0 new
GridGeoViewer I/O Error [object Object]

Maybe I'm missing something with my config - but it was one of those where I went to bed with it working last night showing my Members and GM fine.  Woke up this morning and it no longer is working.

Can't even get the /cgi-bin/network-map.cgi to work either.   Returns a 200 status on the page get in the logs for the CGI but it just sits there cycling on that request.  And now when I go to the map I get the same error as up in the subject here - I/O Error.  Suggestions?

 

The biggest issue I do have is that this is a lab system with tons of data in it so destroying things from scratch is going to be difficult.  I do have a second lab system - but the point is that I want this to be true to anyone who starts off with working with the bloxTools after upgrading from a prior version... assume I can't reset things :)

 

-Michael

+1
0
-1
Tags
Automation Change Manager
Re: GridGeoViewer I/O Error [object Object]

Hi Michael, 

A couple of things.....

Can you execute a show bloxtools from the CLI and paste the output in the thread?  It sounds like memory exhaustion.  Are you running the patched version of network-map.cgi?

 

Also did you leave a browser up on the page all night?

 

What HW platform are you running?

What browser are you running?

 

Thanks!

+1
0
-1
Re: GridGeoViewer I/O Error [object Object]

I have things set at 128mb for toolBlox memory wise - but I didn't leave it up all night.  What I did was had a browser open on my Mac OSX Firefox 3.x client and closed the laptop going into sleep mode so no up all night browser.  Also this is on my IB-1000 (not 1550) which is under VERY light duty as a lab/demo system.  Oh and yes I only started with using the latest patched CGI you posted on another thread Don and you were working on.

I even erased my entire geoviewer directories and configs and re-uploaded (via WS-FTP) the snapin again making sure to edit everything properly.  No luck.

Here is the CLI dump:

Infoblox > show bloxtools
bloxTools status: enabled(GREEN)
CPU: 8%, Memory: 49%, Hard Disk: 8%

49%... only halfway being used.

 

+1
0
-1
Re: GridGeoViewer I/O Error [object Object]

Cool!  We now know it's not due to the environment so let's cover the problem again:

network-map.cgi is apparently timing out and not returning data which is why your client side Javascript would return I/O error.  Do you have Firebug installed on Firefox?  It can tell us exactly how the cgi is being run and what eventually returns.

Also you mentioned that you cannot run the cgi directly, is this correct?    Using FF, try going to https://<your ip>:444/gridgeoviewer/cgi-bin/network-map.cgi

If you do get output from that (even if it takes awhile) paste it back here.

Also try the snmpgrid.cgi script as well please.

+1
0
-1
Re: GridGeoViewer I/O Error [object Object]

I think the problem stems back to me using a NAT'ed address and accessing it internally from within my own network.  What I do is setup the Key (API) for the GeoViewer to use the URL I'd be accessing my things from the outside with.  While it did seem to work initially - things apparently didn't work sometime thereafter.

 

I've send accessed things via the internal IP and it works again.  However getting detailed stats on a device once you click on it is still another problem I need to figure out but the main part is at least working :)

+1
0
-1
Re: GridGeoViewer I/O Error [object Object]

hmm, very strange.  If your URL doesn't exactly match the google maps API key then it shouldn't work and will throw an error stating that the key doesn't match the URL so I don't know what's going on there....  Remember that this is javascript so it is executed on the client side, not the server.

Detailed status only works when you utilize IBGraph to monitor the nodes in your grid with one exception... the GridMaster.  This is presently an issue that when you extract the member attributes via the network-map.cgi application you get back the 'real' IP of the GM which is why you need to set the actual IP of the GM in the WebConfig.pm file.  Now when IBGraph attempts to monitor the GM the only available IP is the private 169.254.253.1 address (due to the underlying implementation/NAT etc of the bloxTools environment)  So when you click on the GM there is no match for IBGraph data with that IP address.  We have done a few RFE's with engineering to make this work better in the future but don't have an immediate workaround yet.

So the net, net is that you presently cannot get additional details on the GM node within Grid GeoViewer yet.

Hope that clears up some of the confusion.

+1
0
-1
Re: GridGeoViewer I/O Error [object Object]

Any idea why in the error log it's looking for a path that doesn't exist?

 

[Wed Oct 29 13:07:34 2008] [error] [client 192.168.0.110] File does not exist: /portal/gridgeoviewer/htdocs/network-map.cgi

+1
0
-1
Re: GridGeoViewer I/O Error [object Object]

Looks like this won't update the thread if you edit something you post...

 

So if someone could tell me where I should be looking with the above error I would appreciate it! :-D

+1
0
-1
Re: GridGeoViewer I/O Error [object Object]

to execute network-map.cgi as listed in several other forum posts go to this path:

 

https://<yourIP>:444/gridgeoviewer/cgi-bin/network-map.cgi

just going to 

https://<yourIP>:444/gridgeoviewer/network-map.cgi 

will yield the above error because the file isn't there.  You do not see portal when you ftp in, however, that is the base directory for the environment and why you see it as path in the conf files and in the system/error log.

 

 

+1
0
-1
Re: GridGeoViewer I/O Error [object Object]

My apologies for not being clear on that error...

 

I can get the Network-map.cgi fine if I go directly to the URL as /cgi-bin/network-map.cgi without an error.  It's when I go to run the Geoviewer by itself - it pauses about 10-20 seconds and then comes up with an error of "Not Found".  That's when I go to the error log and find the corresponding entry saying the above URL which isn't the right path to the Alias'ed CGI file.

 

I've deleted and replaced the Geo Viewer directory twice with fresh copies from the source file making sure to edit each by hand as instructed...  still getting the Not Found (Not Found) error and the log showing it going to the wrong path as above...

 

Quick edit** - I watched Firebug and that not found error is coming up on the snmpgrid.cgi GET - not sure if that helps...  and yes it's edited for the correct SNMP string and to the internal IP  (169.254.253.1).

+1
0
-1
Re: GridGeoViewer I/O Error [object Object]

Sounds like an issue with either your httpd.conf file or the corresponding /conf/snapins/gridgeoviewer.conf

 

+1
0
-1
Re: GridGeoViewer I/O Error [object Object]

Replaced the httpd.conf with the one I pulled from the ibgraph (as you're supposed to) and reuploaded it there.  Restarted Bloxtools... no dice :(

 

Same with the gridgeoviewer.conf - both are pristine from the tar.gz files I pulled them from.  I use WS_FTP (on XP) to put them up and didn't edit either so no changes of CR in the line feeds and such.

+1
0
-1
Re: GridGeoViewer I/O Error [object Object]

please post your copies of your httpd.conf and gridgeoviewer.conf that you are presently running on this thread and we'll help you do some troubleshooting.

Also paste the output of a directory listing of your root dir (ftp to the bloxtools env and perform an ls or a dir command) so that I can see how this is layed out presently.

+1
0
-1
Re: GridGeoViewer I/O Error [object Object]

Directory View (from WS_FTP)

-rwxrwxrwx    1 ftp      ftp          5323 Oct 20 21:19 README.txt
-rwxrwxrwx    1 ftp      ftp          2729 Oct 24 09:58 audit.log
drwxrwxrwx    5 ftp      ftp          4096 Oct 20 21:19 bloxconsole
drwxrwxrwx    4 ftp      ftp          4096 Oct 30 13:35 conf
drwxrwxrwx    4 ftp      ftp          4096 Oct 30 12:59 gridgeoviewer
drwxrwxrwx   17 ftp      ftp          4096 Oct 24 09:58 htdocs
drwxrwxrwx    7 ftp      ftp          4096 Oct 20 21:19 ibgraph
drwxrwxrwx    2 ftp      ftp          4096 Oct 30 13:00 logs
drwxrwxrwx    3 ftp      ftp          4096 Oct 20 21:23 scratch
drwxrwxrwx    2 ftp      ftp          4096 Oct 30 13:35 tmp

 

HTTPD.CONF:

##############################################################################
# UML httpd.conf
##############################################################################

ServerRoot /portal

Listen 169.254.253.254:443
Timeout 300
KeepAlive On
MaxKeepAliveRequests 0
KeepAliveTimeout 600

User nobody
Group nobody

DocumentRoot htdocs

# disabled is default for 2.1.4 and later
UserDir disabled

# warn is default
LogLevel warn
LogFormat "%h %l %u %t \"%r\" %>s %b" common

# Don't change log name and location.  It is fixed from logrotate
CustomLog logs/access.log common
ErrorLog logs/error.log

# return forbidden for TRACE and TRACK methods
RewriteEngine on
RewriteCond %{REQUEST_METHOD} ^(TRACE|TRACK)
RewriteRule .* - [F]

<Directory />
    Options None
    AllowOverride None
    Order allow,deny
    Allow from all
</Directory>

Include conf/snapins/*.conf

##############################################################################
# SSL options
##############################################################################

SSLEngine on
SSLProtocol -ALL +SSLv3 +TLSv1
SSLCipherSuite ALL:!aNULL:!ADH:!eNULL:!LOW:!EXP:RC4+RSA:+HIGH:+MEDIUM
SSLCertificateFile /portal/conf/apache_server.crt
SSLCertificateKeyFile /portal/conf/apache_server.key

SSLPassPhraseDialog  builtin
SSLSessionCache         dbm:/portal/logs/ssl_scache
SSLSessionCacheTimeout  300
SSLMutex file:/portal/logs/ssl_mutex
SSLRandomSeed startup builtin
SSLRandomSeed connect builtin

 

My GRIDGEOVIEWER.CONF

# Grid Geo Viewer

ScriptAlias /gridgeoviewer/cgi-bin/ /portal/gridgeoviewer/cgi-bin/
Alias /gridgeoviewer/ /portal/gridgeoviewer/htdocs/

<Directory /portal/gridgeoviewer/htdocs>
    DirectoryIndex index.html
</Directory>

+1
0
-1
Re: GridGeoViewer I/O Error [object Object]

All that looks good, have you restarted the environment since applying these conf files?

Can you detail how you are attempting access, detail steps, url, browser etc.  Also post the last 30 or so lines from your system.log and error.log.

+1
0
-1
Re: GridGeoViewer I/O Error [object Object]

I've restarted it a few times :) and then some...

 

As for access, I'm using a Windows XP box with Firefox 3.x on the local network as https://192.168.0.2/gridgeoviewer/ and hit enter.  But I've also tried it with Vista and Firefox 3.x and XP with Firefox 2.x - all the same result.

 

I had changed earlier today the machine name of the GM - but I've since changed it back ao ignore the "WARN" messages about the machine name not matching.  This was the same problem prior to today so the error about the host name is only new to today.

 

 

System Log:

Oct 30 15:54:01 (none) ibgraph.pl[904]: "/portal/scratch/var/ibgraph/data/192.168.0.3_dns1.rrd N:0:0:0:0:0:0" [delta 0]
Oct 30 15:54:01 (none) /usr/sbin/cron[14582]: (nobody) CMD (/portal/ibgraph/bin/monitor.sh)
Oct 30 15:54:01 (none) /usr/sbin/cron[14584]: (root) CMD (/etc/run_apache.sh)
Oct 30 15:54:01 (none) /usr/sbin/cron[14586]: (root) CMD (/etc/portal_monitor.sh)
Oct 30 15:54:01 (none) /usr/sbin/cron[14588]: (root) CMD (/etc/vsftpd.pm)
Oct 30 15:54:12 (none) monitor.pl[845]: 7 children: ok
Oct 30 15:54:23 (none) ibgraph.pl[896]: "/portal/scratch/var/ibgraph/data/192.168.0.3_dhcp1.rrd N:0:0:0:0:0:0:0:0:0" [delta 0]
Oct 30 15:54:24 (none) ibgraph.pl[895]: "/portal/scratch/var/ibgraph/data/169.254.253.1_dns2.rrd N:0:0" [delta 0]
Oct 30 15:54:30 (none) ibgraph.pl[882]: "/portal/scratch/var/ibgraph/data/169.254.253.1_dhcp1.rrd N:0:44:0:0:44:0:0:0:0" [delta 0]
Oct 30 15:54:31 (none) ibgraph.pl[893]: "/portal/scratch/var/ibgraph/data/169.254.253.1_dns1.rrd N:4755:74:326:1942:6064:13" [delta 4]
Oct 30 15:54:33 (none) sysvars.pl[846]: query host 169.254.253.1
Oct 30 15:54:33 (none) ibgraph.pl[905]: "/portal/scratch/var/ibgraph/data/192.168.0.3_dns2.rrd N:0:0" [delta 0]
Oct 30 15:54:33 (none) sysvars.pl[846]: query host 192.168.0.3
Oct 30 15:55:01 (none) /usr/sbin/cron[14681]: (nobody) CMD (/portal/ibgraph/bin/monitor.sh)
Oct 30 15:55:01 (none) /usr/sbin/cron[14683]: (root) CMD (/etc/run_apache.sh)
Oct 30 15:55:01 (none) /usr/sbin/cron[14685]: (root) CMD (/etc/portal_monitor.sh)
Oct 30 15:55:01 (none) /usr/sbin/cron[14687]: (root) CMD (/etc/vsftpd.pm)
Oct 30 15:55:07 (none) ibgraph.pl[904]: no sample: get_request(.1.3.6.1.4.1.7779.3.1.1.3.1.1.1.2.7.115.117.109.109.97.114.121): Received genError(5) error-status at error-index 1
Oct 30 15:55:12 (none) monitor.pl[845]: 7 children: ok
Oct 30 15:55:24 (none) ibgraph.pl[896]: "/portal/scratch/var/ibgraph/data/192.168.0.3_dhcp1.rrd N:0:0:0:0:0:0:0:0:0" [delta 0]
Oct 30 15:55:24 (none) ibgraph.pl[895]: "/portal/scratch/var/ibgraph/data/169.254.253.1_dns2.rrd N:0:0" [delta 0]
Oct 30 15:55:30 (none) ibgraph.pl[882]: "/portal/scratch/var/ibgraph/data/169.254.253.1_dhcp1.rrd N:0:45:0:0:45:0:0:0:0" [delta 2]
Oct 30 15:55:31 (none) ibgraph.pl[893]: "/portal/scratch/var/ibgraph/data/169.254.253.1_dns1.rrd N:4755:74:326:1942:6064:13" [delta 0]
Oct 30 15:55:33 (none) ibgraph.pl[905]: "/portal/scratch/var/ibgraph/data/192.168.0.3_dns2.rrd N:0:0" [delta 0]
Oct 30 15:55:33 (none) sysvars.pl[846]: query host 169.254.253.1
Oct 30 15:55:34 (none) sysvars.pl[846]: query host 192.168.0.3
Oct 30 15:56:01 (none) /usr/sbin/cron[14780]: (nobody) CMD (/portal/ibgraph/bin/monitor.sh)
Oct 30 15:56:01 (none) /usr/sbin/cron[14782]: (root) CMD (/etc/run_apache.sh)
Oct 30 15:56:01 (none) /usr/sbin/cron[14784]: (root) CMD (/etc/portal_monitor.sh)
Oct 30 15:56:01 (none) /usr/sbin/cron[14786]: (root) CMD (/etc/vsftpd.pm)
Oct 30 15:56:08 (none) ibgraph.pl[904]: "/portal/scratch/var/ibgraph/data/192.168.0.3_dns1.rrd N:0:0:0:0:0:0" [delta 0]
Oct 30 15:56:12 (none) monitor.pl[845]: 7 children: ok
Oct 30 15:56:24 (none) ibgraph.pl[896]: "/portal/scratch/var/ibgraph/data/192.168.0.3_dhcp1.rrd N:0:0:0:0:0:0:0:0:0" [delta 0]
Oct 30 15:56:24 (none) ibgraph.pl[895]: "/portal/scratch/var/ibgraph/data/169.254.253.1_dns2.rrd N:0:0" [delta 0]
Oct 30 15:56:30 (none) ibgraph.pl[882]: "/portal/scratch/var/ibgraph/data/169.254.253.1_dhcp1.rrd N:0:45:0:0:45:0:0:0:0" [delta 0]
Oct 30 15:56:31 (none) ibgraph.pl[893]: "/portal/scratch/var/ibgraph/data/169.254.253.1_dns1.rrd N:4755:74:326:1942:6064:13" [delta 0]
Oct 30 15:56:33 (none) ibgraph.pl[905]: "/portal/scratch/var/ibgraph/data/192.168.0.3_dns2.rrd N:0:0" [delta 0]
Oct 30 15:56:35 (none) sysvars.pl[846]: query host 169.254.253.1
Oct 30 15:56:36 (none) sysvars.pl[846]: query host 192.168.0.3
Oct 30 15:56:54 (none) vsftpd: Thu Oct 30 15:56:54 2008 [pid 14879] CONNECT: Client "192.168.0.110"
Oct 30 15:56:54 (none) vsftpd: Thu Oct 30 15:56:54 2008 [pid 14878] [admin] OK LOGIN: Client "192.168.0.110"

 

Error log:

[Thu Oct 30 08:38:20 2008] [notice] Digest: generating secret for digest authentication ...
[Thu Oct 30 08:38:20 2008] [notice] Digest: done
[Thu Oct 30 08:38:21 2008] [warn] RSA server certificate CommonName (CN) `nj_site.companyx.com' does NOT match server name!?
[Thu Oct 30 08:38:21 2008] [notice] Apache/2.2.6 (Unix) mod_ssl/2.2.6 \x80\x9f\t\b8\x04\x10\b DAV/2 mod_perl/2.0.3 Perl/v5.8.8 configured -- resuming normal operations
[Thu Oct 30 12:49:48 2008] [error] [client 71.187.174.54] File does not exist: /portal/htdocs/favicon.ico
[Thu Oct 30 12:49:48 2008] [error] [client 71.187.174.54] File does not exist: /portal/htdocs/favicon.ico
[Thu Oct 30 12:55:40 2008] [error] [client 192.168.0.110] File does not exist: /portal/htdocs/favicon.ico
[Thu Oct 30 12:55:43 2008] [error] [client 192.168.0.110] File does not exist: /portal/htdocs/favicon.ico
[Thu Oct 30 13:05:10 2008] [warn] RSA server certificate CommonName (CN) `nj_site.companyx.com' does NOT match server name!?
[Thu Oct 30 13:05:15 2008] [notice] Digest: generating secret for digest authentication ...
[Thu Oct 30 13:05:15 2008] [notice] Digest: done
[Thu Oct 30 13:05:16 2008] [warn] RSA server certificate CommonName (CN) `nj_site.companyx.com' does NOT match server name!?
[Thu Oct 30 13:05:16 2008] [notice] Apache/2.2.6 (Unix) mod_ssl/2.2.6 \x80\x9f\t\b8\x04\x10\b DAV/2 mod_perl/2.0.3 Perl/v5.8.8 configured -- resuming normal operations
[Thu Oct 30 13:25:43 2008] [warn] RSA server certificate CommonName (CN) `nj_site.companyx.com' does NOT match server name!?
[Thu Oct 30 13:25:45 2008] [notice] Digest: generating secret for digest authentication ...
[Thu Oct 30 13:25:45 2008] [notice] Digest: done
[Thu Oct 30 13:25:46 2008] [warn] RSA server certificate CommonName (CN) `nj_site.companyx.com' does NOT match server name!?
[Thu Oct 30 13:25:46 2008] [notice] Apache/2.2.6 (Unix) mod_ssl/2.2.6 \x80\x9f\t\b8\x04\x10\b DAV/2 mod_perl/2.0.3 Perl/v5.8.8 configured -- resuming normal operations
[Thu Oct 30 13:33:06 2008] [warn] RSA server certificate CommonName (CN) `nj_site.companyx.com' does NOT match server name!?
[Thu Oct 30 13:33:08 2008] [notice] Digest: generating secret for digest authentication ...
[Thu Oct 30 13:33:08 2008] [notice] Digest: done
[Thu Oct 30 13:33:09 2008] [warn] RSA server certificate CommonName (CN) `nj_site.companyx.com' does NOT match server name!?
[Thu Oct 30 13:33:09 2008] [notice] Apache/2.2.6 (Unix) mod_ssl/2.2.6 \x80\x9f\t\b8\x04\x10\b DAV/2 mod_perl/2.0.3 Perl/v5.8.8 configured -- resuming normal operations
[Thu Oct 30 13:35:24 2008] [warn] RSA server certificate CommonName (CN) `nj_site.companyx.com' does NOT match server name!?
[Thu Oct 30 13:35:26 2008] [notice] Digest: generating secret for digest authentication ...
[Thu Oct 30 13:35:26 2008] [notice] Digest: done
[Thu Oct 30 13:35:27 2008] [warn] RSA server certificate CommonName (CN) `nj_site.companyx.com' does NOT match server name!?
[Thu Oct 30 13:35:27 2008] [notice] Apache/2.2.6 (Unix) mod_ssl/2.2.6 \x80\x9f\t\b8\x04\x10\b DAV/2 mod_perl/2.0.3 Perl/v5.8.8 configured -- resuming normal operations
[Thu Oct 30 15:58:05 2008] [error] [client 192.168.0.110] File does not exist: /portal/htdocs/gridgeoviewer

 

+1
0
-1
Re: GridGeoViewer I/O Error [object Object]

Logs look good, only thing I see in there is that you attempted to go to https://<yourIP>/gridgeoviewer and left the trailing slash off.

What exactly is the problem that we are trying to solve here, please be specific and provide some supporting information (like logs from when you attempted to access and saw an error!)

 

+1
0
-1
Re: GridGeoViewer I/O Error [object Object]

FYI - the "Not Found" "Not Found" - is related to Google Maps - NOT the bloxTools GeoViewer.

 

As per looking at my network-map.cgi - the error is that I had my Gridmaster with a field of blank for the Comments field (where we pick up the location from)... Not sure how that happened but in the course of swapping systems it now makes sense - however I did do a restore of things...

So bottom line - make sure you have your Comments fields populated if you want to graph things properly.

+1
0
-1
Re: GridGeoViewer I/O Error [object Object]

[quote user="Michael"]I think the problem stems back to me using a NAT'ed address and accessing it internally from within my own network.  What I do is setup the Key (API) for the GeoViewer to use the URL I'd be accessing my things from the outside with.  While it did seem to work initially - things apparently didn't work sometime thereafter.[/quote]

 

One thing I've done to get around this type of issue is to use an FQDN when registering for a Google API key.  I then set up an entry in my hosts file (c:\windows\system32\drivers\etc\hosts) that has the "public" IP address of my host with the map to the FQDN.  If you really need to do this, either you can always access it by going "public" or you can comment and uncomment as necessary.

It works for me anyway.

+1
0
-1
Re: GridGeoViewer I/O Error [object Object]

Another idea...  I use a real FQDN that I use DynDNS to maintain the IP for so that I'm always updating the external IP of my router with one that's associated with an A record that they host.  Then if you REALLY want to get fancy - use a domain internally on your IB box that then point a C Name to the A record DynDNS hosts and it will appear to be whatever you want it to be internally.  However if you're mobile and not using the IB box as your DNS externally - then you simply just put that C Name in your Hosts file...

 

Works for me :)

+1
0
-1