Click here to Skip to main content
16,022,362 members
Please Sign up or sign in to vote.
1.00/5 (1 vote)
See more:
Quote:
I used pdi in a project, the version is 9.1.0.0-324.
I encountered a problem when generating ktr files. The specific error is:
 2024/06/14 15:46:19 - org.pentaho.big.data.impl.cluster.NamedClusterManager@53305564 - ERROR (version Unknown, build 0 from 2024/06/14 15:46:18.580 by zyl) : No metastore found and exception encountered looking for user-specified or legacy metastore
2024/06/14 15:46:19 - org.pentaho.big.data.impl.cluster.NamedClusterManager@53305564 - ERROR (version Unknown, build 0 from 2024/06/14 15:46:18.580 by zyl) : java .lang.NullPointerException.
Quote:
how should I deal with it?


What I have tried:

public StepMeta addOutputHadoopFileMeta(TransMeta transMeta, PluginRegistry registry, int x, int y, String stepName, String separator, String extension,
                                           boolean createParentFolder, String fileName, boolean addToResultFiles, String encoding, TextFileField[] outputFields, String sourceConfigurationName,
                                           String splitevery) {
       NamedClusterManager clusterManager = new NamedClusterManager();
       NamedCluster cluster = new NamedClusterImpl();
       cluster.setStorageScheme("default");
       cluster.setHdfsHost("localhost");
       cluster.setHdfsPort("3004");
       cluster.setName("cloudera");
       cluster.setHdfsUsername("hadoopdev");
       cluster.setHdfsPassword("");
       clusterManager.setClusterTemplate(cluster);
       HadoopFileOutputMeta outputMeta = new HadoopFileOutputMeta(clusterManager, null, null);
       outputMeta.setDefault();
       outputMeta.setSourceConfigurationName(sourceConfigurationName);
       outputMeta.setFileName(fileName);
       outputMeta.setCreateParentFolder(createParentFolder);
       outputMeta.setExtension(extension);
       outputMeta.setAddToResultFiles(addToResultFiles);

       outputMeta.setSeparator(separator);
       outputMeta.setEncoding(encoding);

       outputMeta.setOutputFields(outputFields);

       outputMeta.setSplitEveryRows(splitevery);

       String hadoopFileOutputMetaPluginId = registry.getPluginId(StepPluginType.class, outputMeta);
       StepMeta hadoopFileOutputMetaStep = new StepMeta(hadoopFileOutputMetaPluginId, stepName, outputMeta);
       hadoopFileOutputMetaStep.setLocation(x, y);
       hadoopFileOutputMetaStep.setStepID("HadoopFileOutputPlugin");
       hadoopFileOutputMetaStep.setDraw(true);
       transMeta.addStep(hadoopFileOutputMetaStep);
       return hadoopFileOutputMetaStep;
   }
Posted
Updated 13-Jun-24 23:21pm
v4

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)



CodeProject, 20 Bay Street, 11th Floor Toronto, Ontario, Canada M5J 2N8 +1 (416) 849-8900