GitHub provides hosting for software development version control using Git. This plugin would allow users to select the data sets associated with the specified repository and collect raw level data.

User Expectations

• User would like to enable GitHub API to start retrieving GitHub data associated with repositories 
• User would like to provide 
• User would like to 

Plugin Type

• Batch Source
• Batch Sink 
• Real-time Source
• Real-time Sink
• Action
• Post-Run Action
• Aggregate
• Join
• Spark Model
• Spark Compute

User Configurations

Design / Implementation Tips

Plugin will be implemented using third-part The GitHub Java API library, It is part of the GitHub Mylyn Connector and aims to support the entire GitHub v3 API. Authentication will be performed using access token. Output schema must be automatically generated from selected data. 

References

• GitHub API v3 documentation: https://developer.github.com/v3/
• GitHub API v4 (GraphQL) documentation: https://developer.github.com/v4/
• GitHub API v3 third-part libraries: https://developer.github.com/v3/libraries/