Difference between revisions of "C0334941560"

From FindAndLearn::Cookbook
C0334941560
Jump to: navigation, search
(→‎Subsequent pipeline)
 
(2 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
{{AAAA-Ingestion
 
{{AAAA-Ingestion
−
|HasEntityTitle=From repository by dataspects/dsrepository-cli
+
|HasEntityTitle=From repository by dataspects/dataspecter
 
|HasIngestionType=Feeder
 
|HasIngestionType=Feeder
 
|HasIngestionSource=Repository
 
|HasIngestionSource=Repository
−
|HasIngestionTarget=Datastore
+
|HasIngestionTarget=dataspectsd
−
|HasIngestionFeeder=https://github.com/dataspects/dsrepository-cli
 
 
}}
 
}}
 
==Data fed==
 
==Data fed==
  
−
*https://github.com/dataspects/datastore/blob/master/internal/models/code.go
+
* https://github.com/dataspects/dataspectsd/blob/master/internal/datastore/code.go
  
 
==Configuration==
 
==Configuration==
Line 14: Line 13:
 
Configure the datastore:
 
Configure the datastore:
  
−
  <ID>     automatic
+
  <ID>       automatic
−
  <Label>   Shown in information sources list on https://ui.dataspects.com/search
+
  <Label>     Shown in information sources list on https://ui.dataspects.com/search
−
  <API Key> automatic
+
  <ClientKey> automatic
−
  <Regex>   Only file names matching this regex will be fed to the datastore ([https://regex-golang.appspot.com/assets/html/index.html Regex Tester - Golang])
+
  <Regex>     Only file names matching this regex will be fed to the datastore ([https://regex-golang.appspot.com/assets/html/index.html Regex Tester - Golang])
  
 
Configure the feeder:
 
Configure the feeder:
  
−
  [email protected]:/yourrepo$ ./[https://github.com/dataspects/dsrepository-cli dsrepository-cli] \
+
  [email protected]:/yourrepo$ ./[https://github.com/dataspects/dataspecter dataspecter] \
 
                               --id  <ID>      # From https://ui.dataspects.com/datastores/repositories/code\
 
                               --id  <ID>      # From https://ui.dataspects.com/datastores/repositories/code\
−
                               --url https://datastore.dataspects.com/repositories/code \
+
                               --url https://datastore.dataspects.com \
 
                               --key <API Key> # From https://ui.dataspects.com/datastores/repositories/code
 
                               --key <API Key> # From https://ui.dataspects.com/datastores/repositories/code
−
 
−
== Subsequent pipeline ==
 
−
 
−
Items fed to the datastore will be fed on to an Indexer.
 
−
 
−
Currently the [https://github.com/dataspects/indexer/blob/master/internal/pkg/repository/code.go CodeIndexer] doesn't index the actual file but scans it for {{code|(?i)error *(\d{4}:\d{2})(.*)}}, creates an ErrorCode entity named {{code|\d{4}:\d{2}}} with an annotation "OccursInFile".
 

Latest revision as of 06:50, 2 December 2019

Warning: Display title "From Repository to dataspectsd by" overrides earlier display title "AAAA-Ingestion "From repository by dataspects/dataspecter"".






Data fed[edit | edit source]

Configuration[edit | edit source]

Configure the datastore: 

<ID>        automatic
<Label>     Shown in information sources list on https://ui.dataspects.com/search
<ClientKey> automatic
<Regex>     Only file names matching this regex will be fed to the datastore (Regex Tester - Golang)

Configure the feeder: 

[email protected]:/yourrepo$ ./dataspecter \
                              --id  <ID>      # From https://ui.dataspects.com/datastores/repositories/code\
                              --url https://datastore.dataspects.com \
                              --key <API Key> # From https://ui.dataspects.com/datastores/repositories/code
Retrieved from "https://cookbook.findandlearn.net/w/index.php?title=C0334941560&oldid=1587"