Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-17408

The data pipeline app is not setting the partitions correctly for aggregators

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects versions: None
    • Fix versions: 6.3.0
    • Components: None
    • Labels:
      None
    • Sprint:
    • Release Notes:
      Fixed a bug that caused the number of partitions set by aggregator plugins to be ignored.
    • Rank:
      1|i011rb:

      Description

      The AbstractSparkPreparer is not setting the partitions for both the old and new aggregators, which makes the aggregator always use the same number of partitions as its previous stages. 

        Attachments

          Activity

            People

            • Assignee:
              Albert Shau
              Reporter:
              Yaojie Feng
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: