Troubleshooting

Namenode failure

If the namenode folder missing the path “$InstalledPath \BigDataSDK\Metadata\data\dfs\namenode” or namenode format is not completed properly, follow the given steps:

  1. Delete the Hadoop data folder path “$InstalledPath \BigDataSDK\Metadata\data”.

  2. Format the namenode and start the Hadoop services from the Service Manager.

NOTE

Formatting namenode will clear all the data in it.

  1. Launch Service Manager from the “Syncfusion Big Data Platform” dashboard.

  1. Format the namenode by clicking the “Format Name Node” button in the Service Manager.

  1. Then, start the Hadoop services by clicking the “Start Hadoop Services” button in the Service Manager.

Datanode failure

If the cluster ID version of namenode and datanode mismatches, follow the given steps:

  1. Formatting namenode will be the solution for this case. Refer to the previously mentioned steps to format the namenode.

Reason for cluster ID mismatch

  • Formatting namenode is one of the reasons for the cluster ID mismatch.

Step to ensure the cluster ID in namenode and datanode

  1. Check the version file in the following locations and find whether the cluster ID is same or not.

Version file Path

$InstalledPath\BigDataSDK\Metadata\data\dfs\datanode\current\Version (check clusterID in the file)
$InstalledPath\BigDataSDK\Metadata\data\dfs\ namenode \current\Version (check clusterID in the file)

Syncfusion Big Data SDK service is not running

Syncfusion Big Data Agent service may be stopped or uninstalled, Syncfusion Big Data Studio application requires two dependent window services:

  • Syncfusion Big Data Agent
  • Syncfusion Big Data Remote Agent

To start “Syncfusion Big Data Agent” service in the system, there are two ways:

From Task Manager:

  1. Open the Task Manager.
  2. Under Services tab, find the services “Syncfusion Big Data Agent” and “Syncfusion Big Data Remote Agent”.
  3. Make sure that both the services are running.
  4. If any of the service is not running, right-click the service and start it.

From Command Prompt:

  1. If you cannot find any service in the Task Manager, start the mentioned services manually.
  2. Open the command prompt with administrator privilege.
  3. Change directory $InstalledPath ${BigDataVersion}\Agent.
  4. Install the service using the following syntax. 
    Service name Start

    Eg: SyncfusionBigDataAgent.exe Start

If the window services are not running properly, restart the system once and try to start the service again from the services window. Then, try to start the Hadoop services from the Service Manager.

BindException

If a port on the machine is already in use, the Hadoop services (Name node, Job tracker, Data node, Task tracker, and more.) tries to create its service on that same port.

Port details of the Hadoop services:

Services Port
Name node 50070,9000
Data node 50075, 50010, 50020
Resource Manager 8088, 8033, 8030, 8032,8031,8088
Node Manager 8042,8040
Job History 10033, 19888, 13562, 10020

NOTE

You can find the exception details under the following specified path with the service name as a log file name,
“$InstalledPath \BigDataSDK\Metadata\”.

  • Use the “netstat -a -n -o” command to find whether the ports listening or not.
  • Kill the listening port that causes bind exception and start the Hadoop services from the Service Manager.

    Insufficient disk space

  • Insufficient disk space in the drive has the Hadoop “data” directory.
  • Directory path as “$InstalledPath \BigDataSDK\Metadata\data”.
  • Try to remove the unwanted data from the drive.

Change PostgreSQL username and password

  1. Open the “PostgreSQLCredentialChanger.exe” from the following agent installed location, before opening run the PostgreSQL server.

    “$InstalledPath \Agent\”.

  2. Enter the new username and password in console window.

  1. After changing the credentials, the “Changed successfully PostgreSQL username and password” message is displayed in the console window.
  2. After completing the authentication changes, restart the Big Data Studio Installer agent from the Task Manager and Service Manager from Dashboard.

Restart installer agent:

  1. Open the Task Manager.
  2. Under Services tab, find the services “Syncfusion Big Data Agent”.
  3. Right-click the service and restart it.

Restart Service Manager:

  1. Launch service manager from the “Syncfusion Big Data Platform” dashboard.

  1. Then, stop the Hadoop services by clicking the “Stop Hadoop Services” button in the Service Manager.

  1. If the Hadoop services are stopped successfully, start by clicking the “Start Hadoop Services” button in the Service Manager.

#### Change PostgreSQL port number

  1. Open the Configuration.xml file from the agent installed location “$InstalledPath \Agent\”.
  2. Find the syncfusion.hiveMetastoreDb.port property and update new port number and save the changes.
  3. Restart Syncfusion Big Data studio service manager and installer agent, refer to the previously mentioned steps to restart.