[prev in list] [next in list] [prev in thread] [next in thread] 

List:       drill-dev
Subject:    [jira] [Created] (DRILL-1613) Drill does not honor nested schema changes
From:       "Hanifi Gunes (JIRA)" <jira () apache ! org>
Date:       2014-10-30 18:08:34
Message-ID: JIRA.12751750.1414692495000.374580.1414692514223 () Atlassian ! JIRA
[Download RAW message or body]

Hanifi Gunes created DRILL-1613:
-----------------------------------

             Summary: Drill does not honor nested schema changes
                 Key: DRILL-1613
                 URL: https://issues.apache.org/jira/browse/DRILL-1613
             Project: Apache Drill
          Issue Type: Bug
            Reporter: Hanifi Gunes
            Assignee: Hanifi Gunes


Drill's current definition of schema change is an incremental update to the top-level \
schema structure. This is inappropriate for complex data types where schema change \
may occur at any level in the hierarchy of vectors. Current design does not fit into \
this requirement neatly as only top-level containers are able to mutate the schema. \
We need a minor to major re-design to handle this situation.

This issue exacerbates when querying partitions or batches of files that do not \
necessarily conform to the exact same schema. New fields from upcoming batches will \
be omitted in either case. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[prev in list] [next in list] [prev in thread] [next in thread]