snowflake-connector-python 3.7.0__tar.gz → 3.7.1__tar.gz

{snowflake-connector-python-3.7.0 → snowflake-connector-python-3.7.1}/DESCRIPTION.md

@@ -8,6 +8,15 @@ Source code is also available at: https://github.com/snowflakedb/snowflake-conne
 
 # Release Notes
 
+- v3.7.1(February 21, 2024)
+
+  - Bumped pandas dependency from >=1.0.0,<2.2.0 to >=1.0.0,<3.0.0.
+  - Bumped cryptography dependency from <42.0.0,>=3.1.0 to >=3.1.0,<43.0.0.
+  - Bumped pyOpenSSL dependency from >=16.2.0,<24.0.0 to >=16.2.0,<25.0.0.
+  - Fixed a memory leak in decimal data conversion.
+  - Fixed a bug where `write_pandas` wasn't truncating the target table.
+  - Bumped keyring dependency lower bound to 23.1.0 to address security vulnerability.
+
 - v3.7.0(January 25,2024)
 
   - Added a new boolean parameter `force_return_table` to `SnowflakeCursor.fetch_arrow_all` to force returning `pyarrow.Table` in case of zero rows.
@@ -17,6 +26,7 @@ Source code is also available at: https://github.com/snowflakedb/snowflake-conne
   - Fixed PyArrow Table type hinting
   - Added support for connecting using an existing connection via the session and master token.
   - Added support for connecting to Snowflake by authenticating with multiple SAML IDP using external browser.
+  - Added support for structured types (OBJECT, MAP, ARRAY) to nanoarrow converters.
   - Fixed compilation issue due to missing cstdint header on gcc13.
   - Improved config permissions warning message.
 

{snowflake-connector-python-3.7.0 → snowflake-connector-python-3.7.1}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: snowflake-connector-python
-Version: 3.7.0
+Version: 3.7.1
 Summary: Snowflake Connector for Python
 Home-page: https://www.snowflake.com/
 Author: Snowflake, Inc
@@ -40,8 +40,8 @@ License-File: LICENSE.txt
 License-File: NOTICE
 Requires-Dist: asn1crypto<2.0.0,>0.24.0
 Requires-Dist: cffi<2.0.0,>=1.9
-Requires-Dist: cryptography<42.0.0,>=3.1.0
-Requires-Dist: pyOpenSSL<24.0.0,>=16.2.0
+Requires-Dist: cryptography<43.0.0,>=3.1.0
+Requires-Dist: pyOpenSSL<25.0.0,>=16.2.0
 Requires-Dist: pyjwt<3.0.0
 Requires-Dist: pytz
 Requires-Dist: requests<3.0.0
@@ -70,10 +70,10 @@ Requires-Dist: pytest-timeout; extra == "development"
 Requires-Dist: pytest-xdist; extra == "development"
 Requires-Dist: pytzdata; extra == "development"
 Provides-Extra: pandas
-Requires-Dist: pandas<2.2.0,>=1.0.0; extra == "pandas"
+Requires-Dist: pandas<3.0.0,>=1.0.0; extra == "pandas"
 Requires-Dist: pyarrow; extra == "pandas"
 Provides-Extra: secure-local-storage
-Requires-Dist: keyring!=16.1.0,<25.0.0; extra == "secure-local-storage"
+Requires-Dist: keyring<25.0.0,>=23.1.0; extra == "secure-local-storage"
 
 This package includes the Snowflake Connector for Python, which conforms to the Python DB API 2.0 specification:
 https://www.python.org/dev/peps/pep-0249/
@@ -85,6 +85,15 @@ Source code is also available at: https://github.com/snowflakedb/snowflake-conne
 
 # Release Notes
 
+- v3.7.1(February 21, 2024)
+
+  - Bumped pandas dependency from >=1.0.0,<2.2.0 to >=1.0.0,<3.0.0.
+  - Bumped cryptography dependency from <42.0.0,>=3.1.0 to >=3.1.0,<43.0.0.
+  - Bumped pyOpenSSL dependency from >=16.2.0,<24.0.0 to >=16.2.0,<25.0.0.
+  - Fixed a memory leak in decimal data conversion.
+  - Fixed a bug where `write_pandas` wasn't truncating the target table.
+  - Bumped keyring dependency lower bound to 23.1.0 to address security vulnerability.
+
 - v3.7.0(January 25,2024)
 
   - Added a new boolean parameter `force_return_table` to `SnowflakeCursor.fetch_arrow_all` to force returning `pyarrow.Table` in case of zero rows.
@@ -94,6 +103,7 @@ Source code is also available at: https://github.com/snowflakedb/snowflake-conne
   - Fixed PyArrow Table type hinting
   - Added support for connecting using an existing connection via the session and master token.
   - Added support for connecting to Snowflake by authenticating with multiple SAML IDP using external browser.
+  - Added support for structured types (OBJECT, MAP, ARRAY) to nanoarrow converters.
   - Fixed compilation issue due to missing cstdint header on gcc13.
   - Improved config permissions warning message.
 

{snowflake-connector-python-3.7.0 → snowflake-connector-python-3.7.1}/setup.cfg

@@ -45,8 +45,8 @@ packages = find_namespace:
 install_requires = 
 	asn1crypto>0.24.0,<2.0.0
 	cffi>=1.9,<2.0.0
-	cryptography>=3.1.0,<42.0.0
-	pyOpenSSL>=16.2.0,<24.0.0
+	cryptography>=3.1.0,<43.0.0
+	pyOpenSSL>=16.2.0,<25.0.0
 	pyjwt<3.0.0
 	pytz
 	requests<3.0.0
@@ -93,10 +93,10 @@ development =
 	pytest-xdist
 	pytzdata
 pandas = 
-	pandas>=1.0.0,<2.2.0
+	pandas>=1.0.0,<3.0.0
 	pyarrow
 secure-local-storage = 
-	keyring!=16.1.0,<25.0.0
+	keyring>=23.1.0,<25.0.0
 
 [egg_info]
 tag_build = 

{snowflake-connector-python-3.7.0 → snowflake-connector-python-3.7.1}/setup.py

@@ -94,6 +94,7 @@ if _ABLE_TO_COMPILE_EXTENSIONS and not SNOWFLAKE_DISABLE_COMPILE_ARROW_EXTENSION
                         *((file,) if isinstance(file, str) else file)
                     )
                     for file in {
+                        "ArrayConverter.cpp",
                         "BinaryConverter.cpp",
                         "BooleanConverter.cpp",
                         "CArrowChunkIterator.cpp",
@@ -104,6 +105,8 @@ if _ABLE_TO_COMPILE_EXTENSIONS and not SNOWFLAKE_DISABLE_COMPILE_ARROW_EXTENSION
                         "FixedSizeListConverter.cpp",
                         "FloatConverter.cpp",
                         "IntConverter.cpp",
+                        "MapConverter.cpp",
+                        "ObjectConverter.cpp",
                         "SnowflakeType.cpp",
                         "StringConverter.cpp",
                         "TimeConverter.cpp",

snowflake-connector-python-3.7.1/src/snowflake/connector/nanoarrow_cpp/ArrowIterator/ArrayConverter.cpp

@@ -0,0 +1,64 @@
+//
+// Copyright (c) 2012-2023 Snowflake Computing Inc. All rights reserved.
+//
+
+#include "ArrayConverter.hpp"
+
+#include <memory>
+
+#include "CArrowChunkIterator.hpp"
+#include "CArrowIterator.hpp"
+#include "SnowflakeType.hpp"
+
+namespace sf {
+Logger* ArrayConverter::logger =
+    new Logger("snowflake.connector.ArrayConverter");
+
+void ArrayConverter::generateError(const std::string& msg) const {
+  logger->error(__FILE__, __func__, __LINE__, msg.c_str());
+  PyErr_SetString(PyExc_Exception, msg.c_str());
+}
+
+ArrayConverter::ArrayConverter(ArrowSchemaView* schemaView,
+                               ArrowArrayView* array, PyObject* context,
+                               bool useNumpy) {
+  m_array = array;
+
+  if (schemaView->schema->n_children != 1) {
+    std::string errorInfo = Logger::formatString(
+        "[Snowflake Exception] invalid arrow schema for array items expected 1 "
+        "schema child, but got %d",
+        schemaView->schema->n_children);
+    this->generateError(errorInfo);
+    return;
+  }
+
+  ArrowSchema* item_schema = schemaView->schema->children[0];
+  ArrowArrayView* item_array = array->children[0];
+  m_item_converter = getConverterFromSchema(item_schema, item_array, context,
+                                            useNumpy, logger);
+}
+
+PyObject* ArrayConverter::toPyObject(int64_t rowIndex) const {
+  if (ArrowArrayViewIsNull(m_array, rowIndex)) {
+    Py_RETURN_NONE;
+  }
+
+  // Array item offsets are stored in the second array buffers
+  // Infer start an end of this rows slice by looking at the
+  // current and next offset. If there isn't another offset use
+  // the end of the array instead.
+  int start = m_array->buffer_views[1].data.as_int32[rowIndex];
+  int end = m_array->children[0]->length;
+  if (rowIndex + 1 < m_array->length) {
+    end = m_array->buffer_views[1].data.as_int32[rowIndex + 1];
+  }
+
+  PyObject* list = PyList_New(end - start);
+  for (int i = start; i < end; i++) {
+    PyList_SetItem(list, i - start, m_item_converter->toPyObject(i));
+  }
+  return list;
+}
+
+}  // namespace sf

snowflake-connector-python-3.7.1/src/snowflake/connector/nanoarrow_cpp/ArrowIterator/ArrayConverter.hpp

@@ -0,0 +1,33 @@
+//
+// Copyright (c) 2012-2023 Snowflake Computing Inc. All rights reserved.
+//
+
+#ifndef PC_ARRAYCONVERTER_HPP
+#define PC_ARRAYCONVERTER_HPP
+
+#include <memory>
+
+#include "IColumnConverter.hpp"
+#include "logging.hpp"
+#include "nanoarrow.h"
+#include "nanoarrow.hpp"
+
+namespace sf {
+
+class ArrayConverter : public IColumnConverter {
+ public:
+  explicit ArrayConverter(ArrowSchemaView* schemaView, ArrowArrayView* array,
+                          PyObject* context, bool useNumpy);
+
+  PyObject* toPyObject(int64_t rowIndex) const override;
+
+ private:
+  void generateError(const std::string& msg) const;
+
+  ArrowArrayView* m_array;
+  std::shared_ptr<sf::IColumnConverter> m_item_converter;
+  static Logger* logger;
+};
+
+}  // namespace sf
+#endif  // PC_ARRAYCONVERTER_HPP

{snowflake-connector-python-3.7.0 → snowflake-connector-python-3.7.1}/src/snowflake/connector/nanoarrow_cpp/ArrowIterator/CArrowChunkIterator.cpp

@@ -8,6 +8,7 @@
 #include <string>
 #include <vector>
 
+#include "ArrayConverter.hpp"
 #include "BinaryConverter.hpp"
 #include "BooleanConverter.hpp"
 #include "DateConverter.hpp"
@@ -15,6 +16,8 @@
 #include "FixedSizeListConverter.hpp"
 #include "FloatConverter.hpp"
 #include "IntConverter.hpp"
+#include "MapConverter.hpp"
+#include "ObjectConverter.hpp"
 #include "StringConverter.hpp"
 #include "TimeConverter.hpp"
 #include "TimeStampConverter.hpp"
@@ -193,9 +196,7 @@ std::shared_ptr<sf::IColumnConverter> getConverterFromSchema(
     }
 
     case SnowflakeType::Type::ANY:
-    case SnowflakeType::Type::ARRAY:
     case SnowflakeType::Type::CHAR:
-    case SnowflakeType::Type::OBJECT:
     case SnowflakeType::Type::TEXT:
     case SnowflakeType::Type::VARIANT: {
       converter = std::make_shared<sf::StringConverter>(array);
@@ -378,8 +379,13 @@ std::shared_ptr<sf::IColumnConverter> getConverterFromSchema(
             returnCode);
         scale =
             std::stoi(std::string(scaleString.data, scaleString.size_bytes));
-        byteLength = std::stoi(
-            std::string(byteLengthString.data, byteLengthString.size_bytes));
+
+        // Byte Length may be unset if TIMESTAMP_TZ is the child of a structured
+        // type In this case rely on the default value.
+        if (byteLengthString.data != nullptr) {
+          byteLength = std::stoi(
+              std::string(byteLengthString.data, byteLengthString.size_bytes));
+        }
       }
       switch (byteLength) {
         case 8: {
@@ -408,6 +414,58 @@ std::shared_ptr<sf::IColumnConverter> getConverterFromSchema(
       break;
     }
 
+    case SnowflakeType::Type::ARRAY: {
+      switch (schemaView.type) {
+        case NANOARROW_TYPE_STRING:
+          converter = std::make_shared<sf::StringConverter>(array);
+          break;
+        case NANOARROW_TYPE_LIST:
+          converter = std::make_shared<sf::ArrayConverter>(&schemaView, array,
+                                                           context, useNumpy);
+          break;
+        default: {
+          std::string errorInfo = Logger::formatString(
+              "[Snowflake Exception] unknown arrow internal data type(%d) "
+              "for ARRAY data in %s",
+              NANOARROW_TYPE_ENUM_STRING[schemaView.type],
+              schemaView.schema->name);
+          logger->error(__FILE__, __func__, __LINE__, errorInfo.c_str());
+          PyErr_SetString(PyExc_Exception, errorInfo.c_str());
+          break;
+        }
+      }
+      break;
+    }
+
+    case SnowflakeType::Type::MAP: {
+      converter = std::make_shared<sf::MapConverter>(&schemaView, array,
+                                                     context, useNumpy);
+      break;
+    }
+
+    case SnowflakeType::Type::OBJECT: {
+      switch (schemaView.type) {
+        case NANOARROW_TYPE_STRING:
+          converter = std::make_shared<sf::StringConverter>(array);
+          break;
+        case NANOARROW_TYPE_STRUCT:
+          converter = std::make_shared<sf::ObjectConverter>(&schemaView, array,
+                                                            context, useNumpy);
+          break;
+        default: {
+          std::string errorInfo = Logger::formatString(
+              "[Snowflake Exception] unknown arrow internal data type(%d) "
+              "for OBJECT data in %s",
+              NANOARROW_TYPE_ENUM_STRING[schemaView.type],
+              schemaView.schema->name);
+          logger->error(__FILE__, __func__, __LINE__, errorInfo.c_str());
+          PyErr_SetString(PyExc_Exception, errorInfo.c_str());
+          break;
+        }
+      }
+      break;
+    }
+
     case SnowflakeType::Type::VECTOR: {
       converter = std::make_shared<sf::FixedSizeListConverter>(array);
       break;

{snowflake-connector-python-3.7.0 → snowflake-connector-python-3.7.1}/src/snowflake/connector/nanoarrow_cpp/ArrowIterator/CArrowTableIterator.cpp

@@ -112,6 +112,7 @@ void CArrowTableIterator::reconstructRecordBatches_nanoarrow() {
         case SnowflakeType::Type::BOOLEAN:
         case SnowflakeType::Type::CHAR:
         case SnowflakeType::Type::DATE:
+        case SnowflakeType::Type::MAP:
         case SnowflakeType::Type::OBJECT:
         case SnowflakeType::Type::REAL:
         case SnowflakeType::Type::TEXT:

{snowflake-connector-python-3.7.0 → snowflake-connector-python-3.7.1}/src/snowflake/connector/nanoarrow_cpp/ArrowIterator/DecimalConverter.cpp

@@ -84,8 +84,18 @@ PyObject* DecimalFromDecimalConverter::toPyObject(int64_t rowIndex) const {
   ArrowDecimalGetBytes(&arrowDecimal, outBytes);
   PyObject* int128_bytes = PyBytes_FromStringAndSize(&outBytes, 16);
   */
-  return PyObject_CallMethod(m_context, "DECIMAL128_to_decimal", "Si",
-                             int128_bytes, m_scale);
+  PyObject* return_object = PyObject_CallMethod(
+      m_context, "DECIMAL128_to_decimal", "Si", int128_bytes, m_scale);
+  /**
+  int128_bytes is a new referenced created by PyBytes_FromStringAndSize,
+  to avoid memory leak we need to free it after usage
+  check docs:
+     https://docs.python.org/3/c-api/bytes.html#c.PyBytes_FromStringAndSize
+     https://docs.python.org/3/c-api/refcounting.html#c.Py_XDECREF
+
+  */
+  Py_XDECREF(int128_bytes);
+  return return_object;
 }
 
 }  // namespace sf

snowflake-connector-python-3.7.1/src/snowflake/connector/nanoarrow_cpp/ArrowIterator/MapConverter.cpp

@@ -0,0 +1,79 @@
+//
+// Copyright (c) 2012-2023 Snowflake Computing Inc. All rights reserved.
+//
+
+#include "MapConverter.hpp"
+
+#include <memory>
+
+#include "CArrowChunkIterator.hpp"
+#include "CArrowIterator.hpp"
+#include "SnowflakeType.hpp"
+
+namespace sf {
+Logger* MapConverter::logger = new Logger("snowflake.connector.MapConverter");
+
+void MapConverter::generateError(const std::string& msg) const {
+  logger->error(__FILE__, __func__, __LINE__, msg.c_str());
+  PyErr_SetString(PyExc_Exception, msg.c_str());
+}
+
+MapConverter::MapConverter(ArrowSchemaView* schemaView, ArrowArrayView* array,
+                           PyObject* context, bool useNumpy) {
+  m_array = array;
+
+  if (schemaView->schema->n_children != 1) {
+    std::string errorInfo = Logger::formatString(
+        "[Snowflake Exception] invalid arrow schema for map entries expected 1 "
+        "schema child, but got %d",
+        schemaView->schema->n_children);
+    this->generateError(errorInfo);
+    return;
+  }
+
+  ArrowSchema* entries = schemaView->schema->children[0];
+
+  if (entries->n_children != 2) {
+    std::string errorInfo = Logger::formatString(
+        "[Snowflake Exception] invalid arrow schema for map key/value pair "
+        "expected 2 entries, but got %d",
+        entries->n_children);
+    this->generateError(errorInfo);
+    return;
+  }
+
+  ArrowSchema* key_schema = entries->children[0];
+  ArrowArrayView* key_array = array->children[0]->children[0];
+  m_key_converter =
+      getConverterFromSchema(key_schema, key_array, context, useNumpy, logger);
+
+  ArrowSchema* value_schema = entries->children[1];
+  ArrowArrayView* value_array = array->children[0]->children[1];
+  m_value_converter = getConverterFromSchema(value_schema, value_array, context,
+                                             useNumpy, logger);
+}
+
+PyObject* MapConverter::toPyObject(int64_t rowIndex) const {
+  if (ArrowArrayViewIsNull(m_array, rowIndex)) {
+    Py_RETURN_NONE;
+  }
+
+  // Map ArrowArrays have two child Arrays that contain the the keys and values.
+  // The offsets for how many items belong to each row are stored in the parent
+  // array offset buffer. The start and end of a row slice has to be infered
+  // from the offsets for each row.
+  int start = m_array->buffer_views[1].data.as_int32[rowIndex];
+  int end = m_array->children[0]->length;
+  if (rowIndex + 1 < m_array->length) {
+    end = m_array->buffer_views[1].data.as_int32[rowIndex + 1];
+  }
+
+  PyObject* dict = PyDict_New();
+  for (int i = start; i < end; i++) {
+    PyDict_SetItem(dict, m_key_converter->toPyObject(i),
+                   m_value_converter->toPyObject(i));
+  }
+  return dict;
+}
+
+}  // namespace sf

snowflake-connector-python-3.7.1/src/snowflake/connector/nanoarrow_cpp/ArrowIterator/MapConverter.hpp

@@ -0,0 +1,34 @@
+//
+// Copyright (c) 2012-2023 Snowflake Computing Inc. All rights reserved.
+//
+
+#ifndef PC_MAPCONVERTER_HPP
+#define PC_MAPCONVERTER_HPP
+
+#include <memory>
+
+#include "IColumnConverter.hpp"
+#include "logging.hpp"
+#include "nanoarrow.h"
+#include "nanoarrow.hpp"
+
+namespace sf {
+
+class MapConverter : public IColumnConverter {
+ public:
+  explicit MapConverter(ArrowSchemaView* schemaView, ArrowArrayView* array,
+                        PyObject* context, bool useNumpy);
+
+  PyObject* toPyObject(int64_t rowIndex) const override;
+
+ private:
+  void generateError(const std::string& msg) const;
+
+  ArrowArrayView* m_array;
+  std::shared_ptr<sf::IColumnConverter> m_key_converter;
+  std::shared_ptr<sf::IColumnConverter> m_value_converter;
+  static Logger* logger;
+};
+
+}  // namespace sf
+#endif  // PC_MAPCONVERTER_HPP

snowflake-connector-python-3.7.1/src/snowflake/connector/nanoarrow_cpp/ArrowIterator/ObjectConverter.cpp

@@ -0,0 +1,50 @@
+//
+// Copyright (c) 2012-2023 Snowflake Computing Inc. All rights reserved.
+//
+
+#include "ObjectConverter.hpp"
+
+#include <memory>
+
+#include "CArrowChunkIterator.hpp"
+#include "CArrowIterator.hpp"
+#include "SnowflakeType.hpp"
+
+namespace sf {
+Logger* ObjectConverter::logger =
+    new Logger("snowflake.connector.BinaryConverter");
+
+ObjectConverter::ObjectConverter(ArrowSchemaView* schemaView,
+                                 ArrowArrayView* array, PyObject* context,
+                                 bool useNumpy) {
+  m_array = array;
+  m_converters.clear();
+  m_property_names.clear();
+  m_propertyCount = schemaView->schema->n_children;
+
+  for (int i = 0; i < schemaView->schema->n_children; i++) {
+    ArrowSchema* property_schema = schemaView->schema->children[i];
+
+    m_property_names.push_back(property_schema->name);
+
+    ArrowArrayView* child_array = array->children[i];
+
+    m_converters.push_back(getConverterFromSchema(property_schema, child_array,
+                                                  context, useNumpy, logger));
+  }
+}
+
+PyObject* ObjectConverter::toPyObject(int64_t rowIndex) const {
+  if (ArrowArrayViewIsNull(m_array, rowIndex)) {
+    Py_RETURN_NONE;
+  }
+
+  PyObject* dict = PyDict_New();
+  for (int i = 0; i < m_propertyCount; i++) {
+    PyDict_SetItemString(dict, m_property_names[i],
+                         m_converters[i]->toPyObject(rowIndex));
+  }
+  return dict;
+}
+
+}  // namespace sf

snowflake-connector-python-3.7.1/src/snowflake/connector/nanoarrow_cpp/ArrowIterator/ObjectConverter.hpp

@@ -0,0 +1,32 @@
+//
+// Copyright (c) 2012-2023 Snowflake Computing Inc. All rights reserved.
+//
+#ifndef PC_OBJECTCONVERTER_HPP
+#define PC_OBJECTCONVERTER_HPP
+
+#include <memory>
+
+#include "IColumnConverter.hpp"
+#include "logging.hpp"
+#include "nanoarrow.h"
+#include "nanoarrow.hpp"
+
+namespace sf {
+
+class ObjectConverter : public IColumnConverter {
+ public:
+  explicit ObjectConverter(ArrowSchemaView* schemaView, ArrowArrayView* array,
+                           PyObject* context, bool useNumpy);
+  PyObject* toPyObject(int64_t rowIndex) const override;
+
+ private:
+  static Logger* logger;
+  ArrowArrayView* m_array;
+  int m_propertyCount;
+  std::vector<const char*> m_property_names;
+  std::vector<std::shared_ptr<sf::IColumnConverter>> m_converters;
+};
+
+}  // namespace sf
+
+#endif  // PC_OBJECTCONVERTER_HPP

{snowflake-connector-python-3.7.0 → snowflake-connector-python-3.7.1}/src/snowflake/connector/nanoarrow_cpp/ArrowIterator/SnowflakeType.cpp

@@ -18,6 +18,7 @@ std::unordered_map<std::string, SnowflakeType::Type>
         {"DOUBLE", SnowflakeType::Type::REAL},
         {"FIXED", SnowflakeType::Type::FIXED},
         {"FLOAT", SnowflakeType::Type::REAL},
+        {"MAP", SnowflakeType::Type::MAP},
         {"OBJECT", SnowflakeType::Type::OBJECT},
         {"REAL", SnowflakeType::Type::REAL},
         {"STRING", SnowflakeType::Type::TEXT},

{snowflake-connector-python-3.7.0 → snowflake-connector-python-3.7.1}/src/snowflake/connector/nanoarrow_cpp/ArrowIterator/SnowflakeType.hpp

@@ -31,7 +31,8 @@ class SnowflakeType {
     TIMESTAMP_NTZ = 13,
     TIMESTAMP_TZ = 14,
     VARIANT = 15,
-    VECTOR = 16
+    VECTOR = 16,
+    MAP = 17,
   };
 
   static SnowflakeType::Type snowflakeTypeFromString(std::string str) {

{snowflake-connector-python-3.7.0 → snowflake-connector-python-3.7.1}/src/snowflake/connector/pandas_tools.py

@@ -389,7 +389,7 @@ def write_pandas(
         target_table_location = build_location_helper(
             database,
             schema,
-            random_string() if overwrite else table_name,
+            random_string() if (overwrite and auto_create_table) else table_name,
             quote_identifiers,
         )
 
@@ -417,6 +417,11 @@ def write_pandas(
         )
 
     try:
+        if overwrite and (not auto_create_table):
+            truncate_sql = f"TRUNCATE TABLE {target_table_location} /* Python:snowflake.connector.pandas_tools.write_pandas() */"
+            logger.debug(f"truncating table with '{truncate_sql}'")
+            cursor.execute(truncate_sql, _is_internal=True)
+
         copy_into_sql = (
             f"COPY INTO {target_table_location} /* Python:snowflake.connector.pandas_tools.write_pandas() */ "
             f"({columns}) "
@@ -432,7 +437,7 @@ def write_pandas(
         logger.debug(f"copying into with '{copy_into_sql}'")
         copy_results = cursor.execute(copy_into_sql, _is_internal=True).fetchall()
 
-        if overwrite:
+        if overwrite and auto_create_table:
             original_table_location = build_location_helper(
                 database=database,
                 schema=schema,
@@ -444,7 +449,8 @@ def write_pandas(
             logger.debug(f"rename table with '{rename_table_sql}'")
             cursor.execute(rename_table_sql, _is_internal=True)
     except ProgrammingError:
-        if overwrite:
+        if overwrite and auto_create_table:
+            # drop table only if we created a new one with a random name
             drop_object(target_table_location, "table")
         raise
     finally:

{snowflake-connector-python-3.7.0 → snowflake-connector-python-3.7.1}/src/snowflake/connector/version.py

@@ -1,3 +1,3 @@
 # Update this for the versions
 # Don't change the forth version number from None
-VERSION = (3, 7, 0, None)
+VERSION = (3, 7, 1, None)

{snowflake-connector-python-3.7.0 → snowflake-connector-python-3.7.1}/src/snowflake_connector_python.egg-info/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: snowflake-connector-python
-Version: 3.7.0
+Version: 3.7.1
 Summary: Snowflake Connector for Python
 Home-page: https://www.snowflake.com/
 Author: Snowflake, Inc
@@ -40,8 +40,8 @@ License-File: LICENSE.txt
 License-File: NOTICE
 Requires-Dist: asn1crypto<2.0.0,>0.24.0
 Requires-Dist: cffi<2.0.0,>=1.9
-Requires-Dist: cryptography<42.0.0,>=3.1.0
-Requires-Dist: pyOpenSSL<24.0.0,>=16.2.0
+Requires-Dist: cryptography<43.0.0,>=3.1.0
+Requires-Dist: pyOpenSSL<25.0.0,>=16.2.0
 Requires-Dist: pyjwt<3.0.0
 Requires-Dist: pytz
 Requires-Dist: requests<3.0.0
@@ -70,10 +70,10 @@ Requires-Dist: pytest-timeout; extra == "development"
 Requires-Dist: pytest-xdist; extra == "development"
 Requires-Dist: pytzdata; extra == "development"
 Provides-Extra: pandas
-Requires-Dist: pandas<2.2.0,>=1.0.0; extra == "pandas"
+Requires-Dist: pandas<3.0.0,>=1.0.0; extra == "pandas"
 Requires-Dist: pyarrow; extra == "pandas"
 Provides-Extra: secure-local-storage
-Requires-Dist: keyring!=16.1.0,<25.0.0; extra == "secure-local-storage"
+Requires-Dist: keyring<25.0.0,>=23.1.0; extra == "secure-local-storage"
 
 This package includes the Snowflake Connector for Python, which conforms to the Python DB API 2.0 specification:
 https://www.python.org/dev/peps/pep-0249/
@@ -85,6 +85,15 @@ Source code is also available at: https://github.com/snowflakedb/snowflake-conne
 
 # Release Notes
 
+- v3.7.1(February 21, 2024)
+
+  - Bumped pandas dependency from >=1.0.0,<2.2.0 to >=1.0.0,<3.0.0.
+  - Bumped cryptography dependency from <42.0.0,>=3.1.0 to >=3.1.0,<43.0.0.
+  - Bumped pyOpenSSL dependency from >=16.2.0,<24.0.0 to >=16.2.0,<25.0.0.
+  - Fixed a memory leak in decimal data conversion.
+  - Fixed a bug where `write_pandas` wasn't truncating the target table.
+  - Bumped keyring dependency lower bound to 23.1.0 to address security vulnerability.
+
 - v3.7.0(January 25,2024)
 
   - Added a new boolean parameter `force_return_table` to `SnowflakeCursor.fetch_arrow_all` to force returning `pyarrow.Table` in case of zero rows.
@@ -94,6 +103,7 @@ Source code is also available at: https://github.com/snowflakedb/snowflake-conne
   - Fixed PyArrow Table type hinting
   - Added support for connecting using an existing connection via the session and master token.
   - Added support for connecting to Snowflake by authenticating with multiple SAML IDP using external browser.
+  - Added support for structured types (OBJECT, MAP, ARRAY) to nanoarrow converters.
   - Fixed compilation issue due to missing cstdint header on gcc13.
   - Improved config permissions warning message.