Changes in version 2.9.2 - EDIT base URL (for get_EDIT_ecoclass_by_geoUnit() and make_EDIT_service_URL()) updated to new USDA-managed server: https://edit.sc.egov.usda.gov/ - SoilWeb-based Web Coverage Services (soilColor.wcs(), ISSR800.wcs(), mukey.wcs()) have been updated with FY26 maps, now including most OCONUS soil surveys (AK, HI, PR, PW, GU, AS, MP) - downloadSSURGO() gains arguments include_spatial and include_tabular that are analogous to arguments of the same name from createSSURGO(). Also, added LAPPLY.FUN to support arbitrary parallel or progress reporting backends. Thanks to feature request from @dylanbeaudette (#470). Changes in version 2.9.1 (2026-04-03) - ROSETTA() updates thanks to Todd Skaggs (USDA-ARS): - Now using version 2 of the ROSETTA API (https://www.handbook60.org/rosetta) - New argument est.type for selecting ensemble summary method and resulting units of measure - $Ko$ and $L$ parameters now included in model output - fetchGDB() now supports passing path to SSURGO GeoPackage file via dsn argument - Breaking change: sample SoilProfileCollection datasets (loafercreek, gopheridge, mineralKing) updated to 2.9.x fetchNASIS() schema - Deprecated columns have been removed, following the corresponding changes in 2.9.0 Changes in version 2.9.0 Breaking Changes - Deprecated stringsAsFactors argument has been removed from many query functions, use NASISChoiceList() and/or NASISDomainsAsFactor() instead for manual or automatic setting of domain values as factors, respectively - Deprecated NASIS column aliases have been removed, see https://ncss-tech.github.io/AQP/soilDB/bulletins/2025.01-1-soilDB-NASIS-column-aliases.html for details - R version >= 4.1.0 is now required Documentation - New vignette with details on SoilWeb curated data sources, and related functions in soilDB (#435) - New vignette on Soil Data Access, SDA_query() and high-level wrapper functions for SDA queries in soilDB Improvements - fetchOSD(..., extended = TRUE) gains geomorphon proportions via SoilWeb (#435) - get_SDA_property(method="weighted average") resolved efficiency issues and streamlined SQL Common Table Expressions for processing very large sets of map unit keys (#432) - OSDquery() gains remarks argument for searching the REMARKS section of OSDs Changes in version 2.8.14 - Added family mineralogy class grids - Added argument type for selecting the type of query; replaces deprecated formativeElement - SDA_query() now includes additional metadata (comment header in SQL) to inform usage metrics of various access points to SDA - fetchSDA() and related lower-level child functions now include nasiscoiid and nasischiid for relating to internal database record IDs Changes in version 2.8.13 (2025-09-27) - Added get_SDA_NASIS_key() for obtaining NASIS record IDs for component and component horizon data from Soil Data Access (#409) - SDA_spatialQuery() fixed a bug with new addFields argument and geomIntersection=TRUE (#414) - get_OSD() replace old base URL for result='html' - SDA_query() include soilDB package version in User-Agent string - Vignette updates Changes in version 2.8.12 (2025-08-29) - New Vignettes: - Added vignette for thematic maps of dominant ecological site using Soil Data Access via SDA_spatialQuery() and get_SDA_coecoclass() - Added vignette for creating and using local SSURGO databases via downloadSSURGO() and createSSURGO() - SDA_spatialQuery() now supports addFields argument to add columns to the result from other non-spatial tables. - You can now specify columns from: - "legend", "mapunit", and "muaggatt" tables for what equal to "mupolygon", "mupoint", "muline" or "mukey" - "legend" table for what equal to "areasymbol" or "sapolygon" - "featdesc" for what equal to "featpoint" or "featline" - createSSURGO(): - Added append argument to fix overwrite behavior - Fixed bug in creating non-GeoPackage, non-spatial SQLite output - Improved handling of empty export files and overwrite logic for non-file-based RDBMS - fetchNASIS(): fixed bug when fill=TRUE and there are no horizons in the source data for any profile - get_component_from_SDA() fixed bug in join of "chorizon" and "chfrags" tables, now uses merge(incomparables=NA) - get_vegplot_tree_si_summary_from_NASIS_db() updated for new siteindexcurve table in data model version 7.4.3 Changes in version 2.8.11 (2025-07-11) - Update to NASIS metadata for data model version 7.4.3 - fetchSDA_spatial() geom.src="mlrapolygon" uses a new URL on the DSHub S3 bucket - Added "projectsubtype" and "milestonetype" to the "project" set for get_NASIS_table_name_by_purpose() - Initial phase of syntax cleanup affecting many functions Changes in version 2.8.10 - fetchVegdata() add nullFragsAreZero argument (passed to get_site_data_from_NASIS_db()) - Added soilDB_user_dir() for caching local copies of data for use in soilDB functions (#377) - Added fetchHWSD() and get_HWSD_path() for the FAO Harmonized World Soil Database (#391) - Added get_phroots_from_NASIS_db() for getting pedon horizon root information from NASIS (#393) Changes in version 2.8.9 (2025-04-05) - soilDB now requires aqp >= 2.1.0 - Added get_vegplot_groundsurface_from_NASIS_db() thanks to Greg Schmidt (@phytoclast; #373) - Added "transectgroundsurfcover" table to "vegetation" set for get_NASIS_table_name_by_purpose() - Added missing fetchNASIS("components") deprecation messages for maat_l, maat_r, maat_h, mast_r, ecosite_id, ecosite_name, othervegid, and othervegclass columns - fetchSDA_spatial(geom.src="mlrapolygon"): uses an AWS (S3) source and Seek-optimized ZIP file (thanks to @jneme910) - get_SDA_property() (method "weighted average" and "min/max"), get_SDA_hydric(), and get_SDA_interpretation() (method "weighted average") now use Common Table Expressions (CTEs) and therefore are compatible with local (SQLite or other) data sources Changes in version 2.8.8 (2025-02-10) - fetchSCAN(): Bug fix when sensor column contains all NA - ROSETTA(): now uses HTTPS URL for API endpoint - fetchNASIS(): Bug fix for (now deprecated) pedon_id in horizon slot rather than site - Rebuilt SPC datasets: loafercreek, gopheridge, mineralKing - fetchNASISLabData(): use ncsspedonlabdataiid as unique pedon ID Changes in version 2.8.7 (2025-01-16) - Several aliases of NASIS physical column names have been deprecated and will be removed in the next minor release (2.9.x). See https://ncss-tech.github.io/AQP/soilDB/bulletins/2025.01-1-soilDB-NASIS-column-aliases.html for details (#369) - fetchVegdata() - Added "ecostateid", "ecostatename", "commphaseid", "commphasename" to columns from site and siteobs are now joined into "vegplot" result. - Fixed "site" join used for "vegplot" table result. Now using LEFT join to add siteecositehistory information - Sites without vegetation plots are now excluded from the result - get_vegplot_trhi_from_NASIS_db() & get_vegplot_transect_from_NASIS_db() no longer join to the pedon table. Use the "siteobsiid" or vegetation plot "assocuserpedonid" to join to pedon records when necessary. - This change avoids issues with unintended duplication of records e.g. lab pedons that have multiple pedons per site observation. Thanks to Nathan Roe for suggestion. - get_vegplot_*() functions use INNER join to vegtransect table where applicable, so records are only returned for vegplots with an associated transect. Thanks to Zach Van Abbema for suggestion. - createSSURGO(): more informative error message when no export files found for import - Improved soilDBdata data sets used for unit tests of fetchNASIS() and fetchVegdata() when a local NASIS instance is not available - Updated NASIS SoilProfileCollection data sets (loafercreek, gopheridge, mineralKing) Changes in version 2.8.6 - fetchNASIS() and get_site_data_from_NASIS_db() now return Ecological Site State and Community Phase information (ecostatename, ecostateid, commphasename, commphaseid columns) from Site Observation table - createStaticNASIS() bug fixes - Removed workaround for {odbc}/nanoodbc VARCHAR(MAX) columns; now can directly use DBI::dbReadTable() for all tables via NASIS ODBC connection - Fixed error when output_path=NULL - fetchNASIS() changed default behavior to mixColors=FALSE which returns dominant condition for each moisture state rather than mixing LAB color coordinates - get_colors_from_NASIS_db() deprecate mixColors argument, add method argument with options "dominant", "mixed", and "none". New aggregation method "none" returns long format representation of color data from phcolor table with no aggregation applied. - createSSURGO() updates: - Added incremental write of tabular data by table and soil survey area, which is much more memory efficient - Added maxruledepth argument to allow filtering of cointerp table, and set default to 0. - This reduces number of cointerp rows by about 75% for published SSURGO. Generally, Web Soil Survey exports have maximum rule depth of 1, but custom NASIS exports can be "deeper" - Updated behavior of filename argument when conn DBIConnection is specified and improved overwrite logic - Added dissolve_field to facilitate creating aggregate geometries by "mukey" or other spatial attribute - Added include_tabular argument to support omitting tabular data when building a database - Now include_spatial and include_tabular are allowed to be a character vectors of table names - TRUE is all tables, FALSE is no tables. This allows for subsets of the SSURGO data model to be specified with finer user control over database contents. - Now a composite "soil_metadata" table is made with "areasymbol" column and one row per soil survey area, rather than one table per soil survey area. This is more compact and scales better to larger databases. Changes in version 2.8.5 (2024-11-05) - fetchLDM() add support for area_type argument with local database connections (dsn argument) - fetchSCAN() updates: - Improved SCAN, CSCAN, SNOTEL, SNOWLITE station metadata (#61) via @jskovlin - Timezone support for hourly data requested by fetchSCAN() (#184) - All above-ground sensors are now returned, instead of just the first of each type (#359) - Added new help file on NASIS database sources; see ?NASISLocalDatabase (#360) - get_SDA_*() function updates related to consistent parameters for miscellaneous areas and minor components (#361) - fetchSOLUS(): New function for downloading data from Soil Landscapes of the United States 100-meter (SOLUS100) soil property maps project repository (#362) - fetchNASIS() more consistent QC messages and output for multiple site observations and lab samples - Updated SoilProfileCollection data sets (loafercreek, gopheridge, mineralKing) for aqp 2.1.x object definition and recent changes to fetchNASIS() (#363) Changes in version 2.8.4 (2024-08-17) - createSSURGO() bug fixes following changes in 2.8.3 - generating gpkg_contents for GeoPackage files failed to add entries for "features" data_type - filename argument not properly handled in some cases - SDA_query() handle another possible failure point in error handling code - createStaticNASIS() use odbc::dbListFields() instead of odbc::odbcConnectionColumns() Changes in version 2.8.3 (2024-06-11) - Updates to SoilWeb web coverage services - ISSR800 authoritative grid system altered slightly - ISSR800.wcs() and soilColor.wcs() now set color table internally when possible - updated source data: ISSR800 (FY24) and soil color (FY23) - SDA_query() updates - Better messaging on error - Handle try-error result more gracefully in high-level functions (#352) - createSSURGO(): added support for creating DuckDB, PostgreSQL, and other DBI-compatible databases (#352) via conn argument - fetchSDA() and get_chorizon_from_SDA() concatenate multiple texcl using a comma when a texture group contains multiple texture classes (e.g. stratified textures) (fixes #353) - fetchNASIS()/.formatLandformString(): append geomfmod column to landscape, landform, and microfeature strings where present; thanks to Gabriel Benitez for suggestion - fetchNASIS()/get_extended_data_from_NASIS_db(): fix conversion of codes to labels for microrelief - fetchSCAN(): fix header format; thanks to @dschlaep for reporting and providing a fix Changes in version 2.8.2 (2024-04-22) - SoilWeb Web Coverage Service MUKEY grid data source (used for mukey.wcs()) and metadata have been updated for FY2024 - Note that ISSR800 WCS (ISSR800.wcs() source) is still using FY2023/FY2022 data - get_SDA_coecoclass() default data returned for methods "Dominant Component", "Dominant Condition" and "None" now include localphase column - get_soilseries_from_NASIS() and get_competing_soilseries_from_NASIS(): add SS argument for parity with all other NASIS "get" methods - default to FALSE for backward compatibility/common use cases - get_site_data_from_NASIS_db() gains Frost Free Days, MAP, REAP, MAAT, MAST, MSAT, MSST, MWAT, MWST, and Parent Material Group Name; thanks to Zach Van Abbema for suggestion - Changes in column names related to Area table / "areasymbol" (#272); thanks to Zach Van Abbema for suggestion - get_site_data_from_NASIS_db(): Add state, county, and MLRA areasymbol references ("site_state", "site_county", "site_mlra") - get_mapunit_from_NASIS_db(): Add dominant MLRA areasymbol reference column "lmapunit_mlra" - get_soilseries_from_NASIS(): replace areasymbol column to use relationship-style name "soilseries_typelocst" (minor breaking change) - fetchSDA_spatial(): Add support for querying mapunit point ("mupoint"), mapunit line ("muline"), special feature point ("featpoint"), special feature line ("featline") by mukey or featkey, geometry type selectable via geom.src argument - SDA_spatialQuery(): Add support for querying mapunit point ("mupoint"), mapunit line ("muline"), special feature point ("featpoint"), special feature line ("featline") for a spatial extent, geometry type selectable via what argument - simplifyFragmentData() / simplifyArtifactData() efficiency improvement when all records are missing data Changes in version 2.8.1 (2024-01-09) - get_mapunit_from_NASIS(), get_lmuaoverlap_from_NASIS() and get_legend_from_NASIS() gain areatypename argument used for filtering legends by areatypename. - Default results include "Non-MLRA Soil Survey Area" and "MLRA Soil Survey Area". Set to NULL for no filter. - Fixed bugs in waterDayYear() and summarizeSoilTemperature() for leap years (#333) - fetchSoilGrids() upgrades - Fixed a bug with data.frame output - Requests for more than 5 sites now include a call to Sys.sleep() to conform with ISRIC "Fair Use" policy - Upgraded SoilProfileCollection spatial promotion for aqp 2.0+ - Added 10 kPa, 33 kPa and 1500 kPa water content estimates to default variable sets for point and grid queries - fetchSDA_spatial() gains ability to query mapunit delineations by Ecological Site ID (by.col="ecoclassid") - get_SDA_coecoclass() default ecoclasstypename is now c("NRCS Rangeland Site", "NRCS Forestland Site"), as this is the most common type of aggregation and is least prone to producing unusual composition-related errors due to duplications - Fixed bug related to merging tables/integer data type - Fixed bug in calculation of "Not assigned" fraction of mapunits which could result in negative aggregate component percentages below the default threshold Changes in version 2.8.0 (2023-12-22) - Minimum {aqp} version set to v2.0.2. This is due to changes in the namespace related to aqp::col2Munsell(), to "encourage" users to update to the more efficient routines provided in {aqp} 2+ (if they haven't already), and prepare for future updates in the 2.x series. - Fix bugs in get_SDA_interpretation() when dsn refers to a local SQLite source and in concatenation of reason string when wide_reason=TRUE - createSSURGO() updates: - Breaking change: Now uses the standard SSURGO layer names for spatial data (e.g. "mupolygon" rather than "soilmu_a"). - Creates indices for foreign keys and other columns important for data analysis, dramatically improving the performance of standard queries on SQLite sources. - Now works properly on STATSGO data sets for individual states or CONUS. Previously tabular data would be transferred but spatial data were not. - downloadSSURGO() gains db argument which gives ability to download STATSGO by state or all of US from Web Soil Survey. Thanks to Meghan Krueger for suggestion. - get_SDA_property(): weighted average/dominant component numeric methods now return mukey in first column position; for parity with other get_SDA* methods recently updated/already doing this, making it easier to use these columns for raster attribute tables via terra::set.levels() - fetchNASIS(lab=TRUE) fixed a bug when multiple phlabresults records are present for a single horizon, but one or both is missing bottom depth. Thanks to Meyer Bohn (@MollicMeyer) for reporting. - SoilProfileCollection objects now include a time stamp in their metadata, accessed as: metadata(x)$created (#235) - Added area_type argument to fetchLDM() for non-SSA area queries (#328) - Added grid argument to fetchSoilGrids() for downloading Cloud-Optimized GeoTIFF subsets for spatial extent (#329) - fetchOSD() now automatically batches requests into sets of 100 series, allowing arbitrarily large requests to be made (#239) Changes in version 2.7.10 (2023-11-16) - fetchSDA_spatial() gains geom.src="mlrapolygon" for obtaining Major Land Resource Area (MLRA) polygon boundaries. When using this geometry source x is a vector of MLRARSYM (MLRA Symbols). - The geometry source is the MLRA Geographic Database v5.2 (2022) which is not (yet) part of Soil Data Access. Instead of SDA, GDAL utilities are used to read a zipped ESRI Shapefile from a remote URL: https://www.nrcs.usda.gov/sites/default/files/2022-10/MLRA_52_2022.zip. Therefore, most additional fetchSDA_spatial() arguments are not currently supported for the MLRA geometry source. In the future a mlrapolygon table may be added to SDA (analogous to mupolygon and sapolygon), and the function will be updated accordingly at that time. - Web coverage services and related raster attribute tables provided by SoilWeb (mukey.wcs() etc.) are now using the SoilWeb load-balancer URL - get_SDA_coecoclass() gains method="all" for aggregating information about ecological sites and related components. The method performs a condition-based aggregation for each ecological site condition in the map unit, producing a "wide" data.frame result with as many columns as needed to portray all site conditions. - fetchLDM() gains new argument WHERE for supplying a custom SQL where clause for selecting sites of interest. For example: fetchLDM(WHERE = "CASE WHEN corr_name IS NOT NULL THEN LOWER(corr_name) ELSE LOWER(samp_name) END = 'musick'") Changes in version 2.7.9 - Added new method options for fetchSDA_spatial(). Aggregation grouping is controlled by the by.col argument. This works for mapunit and survey area polygon geometries, aggregating all polygons in the group for each mukey, nationalmusym, lkey, or areasymbol extent. - method="extent" method calculates a bounding rectangle - method="convexhull" calculates the convex hull - method="union" returns a MULTIPOLYGON - method="collection" returns a GEOMETRYCOLLECTION Bug Fixes - Bug fix for get_vegplot_transpoints_from_NASIS_db(); using wrong record ID for transect points - get_NASIS_table_name_by_purpose() now includes "pointplantcoverdetails", "plantprodquadratdetails" in the "vegetation" table purpose group Changes in version 2.7.8 (2023-08-29) - Added new SoilWeb "Web Coverage Service" vignette (https://ncss-tech.github.io/soilDB/articles/wcs-ssurgo.html) related to creating thematic maps using grids of mapunit keys from SoilWeb with aggregated tabular data from Soil Data Access. - get_SDA_*() functions now all return mukey values in first column - mukey.wcs() gains a 30m gridded version of Hawaii and Puerto Rico SSURGO data via db="HI_SSURGO" and db="PR_SSURGO", respectively. - get_vegplot_data_from_NASIS_db(): now uses LEFT join to plant table so that empty records can be diagnosed; thanks to @natearoe for suggestion - Added new NASIS query functions for vegetation transect point and quadrat details: get_vegplot_prodquadrats_from_NASIS_db() and get_vegplot_transpoints_from_NASIS_db() Bug Fixes - get_SDA_property(method="Dominant Component (Numeric)") now includes minors by default, fixing issues with STATSGO mapunits that have no major components flagged. (@dylanbeaudette) - get_component_data_from_NASIS_db(): removed duplicated hydricrating column, also now includes climate columns with standard names. This is a continuation of the idea that custom aliases for standard NASIS columns are deprecated (https://github.com/ncss-tech/soilDB/issues/242) - .pickBestEcosite() now considers record_when_last_updated in lieu of correlation date; this stabilizes sort order from SQLite snapshot v.s. NASIS local database sources (https://github.com/ncss-tech/soilDB/issues/295) - get_component_from_GDB(): fixes for batching over component geomorphic description and parent material group - get_mapunit_from_SDA(): handle possibility of mapunit-level SDA query failure Changes in version 2.7.7 (2023-03-10) Enhancements - fetchNASIS(from="pedons") and get_site_data_from_NASIS_db() now return siteobsiid column (@natearoe) - mukey.wcs() gains experimental gridded STATSGO layer (300m) - Add get_NASIS_table_metadata() for returning information about columns in NASIS tables. - simplifyFragment/ArtifactData(): downgrade warnings - get_cosoilmoist_from_SDA(): mukey and cokey now included when duplicates=TRUE; thanks to @andypaolucci for catching this - fetchSoilGrids() - Add SpatVector coercion for input locations (already supported sf/sp classes) - Add handling for messages from API about erroneous input - Add fetchNASIS("pedons") columns vignette - Add get_NASIS_table_metadata() and optional argument include_description for get_NASIS_metadata() and get_NASIS_column_metadata() - get_SDA_cosurfmorph() + get_SDA_pmgroupname(): support for including or excluding misc. areas via miscellaneous_areas argument - get_site_data_from_NASIS_db(): - Omit "multiple horizontal datums" warning - Remove calculated X/Y long/lat + add proper NASIS alias for long/lat - Add siteothvegclass id/name - add tables to default lookup/site sets Bug fixes - dbQueryNASIS(..., close=TRUE) now calls dbDisconnect() on.exit() (ensuring connections get closed on error) - fetchSCAN(): - 2x requests when timeseries argument not specified - Account for no results (e.g. year = 1800) - Bug fix in vectorization when daily + hourly data requested - downloadSSURGO(): - Handle SDA_query() with invalid syntax in WHERE clause - Fix for include_template=FALSE - createSSURGO() - Attribute tables are now added to gpkg_contents when output filename is a GeoPackage - Fix for .get_comonth_from_SDA() - Fix selected set (SS argument) for get_ecosite_history_from_NASIS_db() in get_site_data_from_NASIS_db() - get_SDA_pmgroupname: return NA (not "NULL") for empty/missing pmgroupname when simplify=TRUE - SDA_spatialQuery(): - geomIntersection=TRUE with db="SAPOLYGON" now correctly labels the areasymbol column (previously was mukey) to match geomIntersection=FALSE and SDA schema - Bounding box extent polygons are now only calculated for SpatRaster (not SpatVector) input Changes in version 2.7.6 (2022-12-02) - All references to soilDB.env have been replaced with a function that returns that environment object (get_soilDB_env()); thanks to @MollicMeyer for identifying this as a problem in #277. This object used to be exported but was unintentionally omitted from NAMESPACE; this has been fixed. - fetchNASIS(lab=TRUE) bug fix related to many:1 relationships between lab samples and morphologic horizons with all-missing columns having logical datatype (#277) - Added get_SRI() and fetchSRI() functions for accessing USFS Region 6 Soil Resource Inventory information from https://ecoshare.info/; thanks to @joshualerickson for the contribution (https://github.com/ncss-tech/soilDB/pull/274) - fetchLDM() now sets the horizon designation metadata like other fetch* functions that return SoilProfileCollection objects (@dylanbeaudette) - mukey.wcs() fix spurious warnings occasionally given due to minor differences (rounding) of grid dimensions - {curl} has been moved from Suggests to Imports - simplfyFragmentData() alias for simplifyFragmentData() removed (@infotroph) Changes in version 2.7.5 (2022-10-18) - Updates to SSURGO File Geodatabase functions (fetchGDB() and related) by @smroecker - Added soilColor.wcs() to access a web coverage service for soil color at various depths by @dylanbeaudette - waterDayYear(): fix for CRAN and different timezones; now defaults to tz="UTC" #268 - summarizeSoilTemperature(): set default timezone to tz="UTC" - Fix for uncode() on pre-decoded values when ChoiceName and ChoiceLabel overlap #273 - Fix for NASISChoiceList() related to #273 - get_soilseries_from_NASIS(): Remove areaacres and obterm for #272 by @smroecker - Fix for get_OSD(..., fix_ocr_errors = TRUE) with empty typical profile for #271 by @dylanbeaudette - fetchNASIS() drops non-representative and additional when dropNotRepresentative/dropAdditional are set (@natearoe) - Fix for as.POSIXct() in R 4.3+; for #265 - Fix for "status was 'SSL connect error" for fetchKSSL() and other functions that download JSON (@kramdog) - Now uses standard soilDB {curl} handle, which includes a longer timeout and ssl_verifyhost=0 - Fixes for compatibility with {jsonlite} >1.8.1 that now uses {base} rather than {curl} - Update row count expectations for end of FY22 SSURGO refresh Changes in version 2.7.4 (2022-09-30) - uncode() replaced \(x) syntax inadvertently included in a recent update to fix R < 4.1 compatibility; thanks to @cbrueffer for catching this (https://github.com/ncss-tech/soilDB/issues/262)! - get_SDA_property() fixes for weighted average method (https://github.com/ncss-tech/soilDB/issues/229, https://github.com/ncss-tech/soilDB/issues/261) - fetchOSD() now automatically encodes horizon distinctness codes to default depth offsets, stored in hz-level attr: hzd Changes in version 2.7.3 (2022-08-19) - get_SDA_property() all methods now support miscellaneous_areas argument. This defaults to FALSE for the methods it was previously implemented for--so be aware that queries using "Dominant Component" or "Dominant Condition" (which previously did not respond to miscellaneous_areas) may have the number of rows in result reduced due to omission of miscellaneous land types. If this is unexpected or undesired, please use miscellaneous_areas=TRUE. (https://github.com/ncss-tech/soilDB/issues/257) - Adds get_NASIS_metadata() and helper method get_NASIS_column_metadata() and other new tools for working with uncode(), factors and NASIS metadata cached in the package. - Bug fix for get_cosoilmoist_from_SDA(); thanks to Monika Shea @monikashea for reporting the problem (https://github.com/ncss-tech/soilDB/issues/253) - fetchNASIS_report() now works with the output from "get_site_from_NASIS" report (useful for site records without associated pedons) - createSSURGO() gains arguments quiet and include_spatial to toggle messages and inclusion of spatial data in created SQLite database, respectively - downloadSSURGO() now handles queries against sacatalog that return no results more gracefully - get_OSD(): Add fix_ocr_errors argument for result='json' to fix common optical character recognition errors associated with horizon designations and colors (NOTE: does NOT fix depths) - fetchSCAN() gains timeseries argument to support batch downloads of hourly data. Additional arguments (...) are passed as a raw request, allowing other parameters sent in request to be modified if needed, and bypassing batch functionality. This is similar to the req argument syntax used in earlier versions of this function, which had been deprecated for some time now. Thanks to Matthew Morriss for raising the discussion item @morrismc99 (https://github.com/ncss-tech/soilDB/discussions/260). - {curl} moved from Suggests to Imports; curl::curl_download() is now used instead of utils::download.file() because it seems to handle SSL certificates better on some networks. Changes in version 2.7.2 (2022-06-27) - fetchNASIS("components'): Fix and refactor ( breaking change from 2.7.1, which introduced a bug/inconsistency) of recent change; duplicates argument is now required to merge in data from mapunit/legend tables (where many:1 relationships between legend/mapunit and datamapunit are possible). In 2.7.1 possibly incomplete mapunit/legend tables could be joined to SoilProfileCollection result (if and only if the tables were populated in selected set/local DB). Does not change historic (<=2.7.0) default behavior. Thanks to @dylanbeaudette for suggesting use of get_component_correlation_data_from_NASIS_db() here. - Several fixes for Roxygen documentation (notably for ROSETTA() and various NASIS web report related functions) that were missing @export tags. Several previously-exported functions missed being explicitly exported in the new Roxygen-generate NAMESPACE. These unintentional omissions from 2.7.1 NAMESPACE have been resolved. - Fixes an old bug in fetchSDA()/get_chorizon_from_SDA() related to LEFT OUTER versus RIGHT JOIN to chtexture table Changes in version 2.7.1 (2022-06-10) - get_SDA_coecoclass() better handling of NULL ecoclassref; support for filtering on ecoclasstypename; not_assigned_value now applies to ecoclassname, ecoclasstypename and ecoclassref columns in addition to ecoclassid; Thanks to Andy Paolucci and Jason Nemecek. Also, added additional columns from legend/mapunit tables (areasymbol, lkey, muname). - fetchNASIS(from="components") now returns mapunit and legend information (if loaded in local NASIS database); results now contain mustatus and repdmu which can be used to remove components from additional mapunits and non-representative data mapunits; thanks to Nathan Roe - Convert UTF-8 strings in us_ss_timeline result to ASCII - SDA_query(): Fixed POST request that could produce unhandled errors on network failure (now returns try-error like other error-causing code) - SDA_query(): In the event of a syntax error, error contents are now returned as a message, not a warning. - uncode() and code() now work with data.table and tibble objects. - Various fixes to tests and error handling code to reduce likelihood of thrown errors from network problems or missing suggested packages. Changes in version 2.7.0 (2022-05-18) - Spatial - Dropped imports from sp and raster which means soilDB no longer requires the soon-to-retire rgdal package. - All spatial data processing has been moved to sf and terra, which have been added to Suggests. - (breaking change) Classes from these packages (e.g. sf, SpatRaster) will be returned by default rather than Spatial*DataFrame or RasterLayer from sp and raster. - (breaking change) Spatial functions that take spatial input will return the same class type as the input unless otherwise specified. - fetchSDA_spatial() and SDA_spatialQuery() gain as_Spatial argument; when TRUE equivalent (backward compatible) sp and raster data types are returned. - Alternately, you may set options(soilDB.return_Spatial=TRUE) - mukey.wcs() and ISSR800.wcs() bug fix for some instances where the target extent was miscalculated, resulting in slight differences from requested resolution (res argument) of result. - mukey.wcs() gains a new possible data source db="RSS" which accesses a Web Coverage Service containing grids from Raster Soil Surveys in the United States. - See: https://github.com/ncss-tech/soilDB/pull/229 for more details on what has changed. - NASIS - (breaking change) rmHzErrors argument now defaults to FALSE. Please let us know if allowing horizon errors results in unexpected behavior so we can repair various interfaces that rely on no errors being present. See aqp::checkHzDepthLogic() for more information on the types of things that used to result in profiles being removed from results and for guidelines on how to fix. - Added several new columns from the plotplantinventory table to get_vegplot_species_from_NASIS_db() result; thanks to Zachary Van Abbema for suggestion and feedback - Local NASIS metadata used for uncode() are now cached within an R session which results in faster query processing times for users with a local NASIS database connection set up. - The db argument to uncode() has been deprecated. Now, code() and uncode() can use ChoiceName and/or ChoiceLabel in coding and decoding ChoiceValue for all data sources. - Rock fragment and artifact sieving now uses <76mm as the upper boundary for gravel fraction, and a related QC message has been removed - SSURGO / Soil Data Access - Added get_SDA_cosurfmorph(): a new function in "SSURGO On Demand" style. Users can customize the WHERE clause, target tables and the grouping variable used to calculate proportions (default by="compname") - "cosurfmorphgc" summarizes "geomposmntn", "geomposhill", "geomposflats", "geompostrce" - "cosurfmorphhpp" summarizes "hillslopeprof" - "cosurfmorphss" summarizes "shapeacross", "shapedown", and concatenated "surfaceshape" - Several fixes for logic of get_SDA_property() with method="weighted average" and include_minors=TRUE/miscellaneous_areas=TRUE, thanks to Andy Paolucci and Dylan Beaudette for testing and providing feedback on the queries. - All get_SDA_*() methods (except get_SDA_metrics()) now support input of custom WHERE clause in lieu of mukeys/areasymbols arguments and gain a dsn argument for specifying a local SQLite database or DBIConnection. - Added downloadSSURGO() for downloading/extraction of the SSURGO data by survey area from Web Soil Survey. - Added createSSURGO() for building of local databases as SQLite/Geopackage from one or more SSURGO exports. Changes in version 2.6.15 (2022-04-14) - fetchNASIS() - New mixColors argument used to toggle color mixing for pedon horizons with multiple colors per moisture state. - Default TRUE mixes colors based on reported color percentage via estimateColorMixture(). FALSE returns the dominant color in each moisture state, or first record for cases without colorpct populated. - Added taxreaction and taxfamhahatmatcl to extended taxonomic information - Added new option (soilDB.NASIS.skip_uncode) to bypass uncode() in NASIS functions (mostly used for debugging or special database instances that come pre-decoded) - An instance in fetchNASIS(from="components") where local database connection was left open was fixed - Added fetchLDM() function to access Kellogg Soil Survey Lab Data Mart via Soil Data Access or local SQLite snapshot (https://github.com/ncss-tech/soilDB/pull/243) - Added get_SDA_metrics() for accessing usage metrics for Soil Data Access, Web Soil Survey and the Lab Data Mart. Thanks to Jason Nemecek for submitting the base SQL query - get_SDA_interpretation(method = "dominant condition") now includes total_comppct_* columns reflecting the summed component percentage of the dominant condition - Updated metadata for SCAN sites that were missing pedlabsampnum (KSSL Pedon Sample ID) Changes in version 2.6.14 (2022-03-15) - waterYearDay() bug fix for more specific (sub-daily) date-time formats - fetchSCAN() better handling of empty results in multi-site queries - Updates to queries, metadata and sample datasets for NASIS 7.4.1 Database Model - fetchNASIS("pedons") no longer includes pmweathering - fetchNASIS("components") no longer includes ecositeorigin - New Component Ecological Site attributes added - stringsAsFactors argument to soilDB functions has been deprecated in favor of a package option - Default behavior for NASIS domains is to return character labels rather than coded factors - Use NASISDomainsAsFactor(TRUE) to toggle package option soilDB.NASIS.DomainsAsFactor Changes in version 2.6.13 (2022-01-31) - fetchSDA_spatial now supports by.col "areaname", "mlraoffice", and "mouagencyresp"; thanks to suggestion by Jay Skovlin - fetchNASIS fix for multiple site observation records with surface fragments; thanks to bug report from Brianna Wegner - waterYearDay() use format and timezone for start date conversion - fetchNASIS fix for from="components", SS=FALSE and queries where no NASIS local database is present (e.g. from SQLite source) - Update to NASIS_table_column_keys dataset of NASIS primary and foreign keys by table name to include many more tables - fetchVegdata() no longer errors for child table queries unless site/site observation/vegetation plot records are missing - fetchOSD(extended=TRUE) now returns an element "NCCPI" containing the National Commodity Crop Production Index summaries. The values returned are quantiles at the 1, 5, 25, 50, 75, 95, and 99% levels over all SSURGO components with compname matching series for irrigated and non-irrigated condition. Changes in version 2.6.12 (2022-01-08) - get_SDA_property() now works with mixed component and horizon-level properties; thanks to Matthieu Stigler for the bug report - Added get_SDV_legend_elements() for fetching and parsing XML for Soil Data Viewer / Web Soil Survey-style symbol themes for soil interpretations from Soil Data Access - fetchNASIS() pedon and component geomorphic summaries now include columns for landscape, microfeature, microrelief, 2D/3D morphometry, and slope shape - fetchNASIS('pedons') now uses simplifyFragmentData() for surface fragments Changes in version 2.6.11 - fetchSDA() handle NULL component-level results with an informative error - fetchSDA() now (again) returns mapunit/legend-level information via get_mapunit_from_NASIS() - createStaticNASIS() and queries to SQLite NASIS snapshots now preserve date/time using RSQLite 2.2.4+ via extended_types=TRUE argument to dbConnect() - get_soilseries_from_NASIS() now returns soiltaxclasslastupdated as a date/time and stores the year in calculated column soiltaxclassyearlastupdated - Added several tables to thematic groups in get_NASIS_table_name_by_purpose() - fetchOSD() gains surface shape proportions in extended shape_across and shape_down tables - SDA_spatialQuery() what='mukey' now works with db='STATSGO' - Added metadata to loafercreek, gopheridge and mineralKing - waterYearDay() pass through format argument for POSIX time conversion Changes in version 2.6.10 (2021-12-15) - waterDayYear() and .formatDates() allow optional format and tz argument; used for consistent POSIX time conversion in tests where date/time has granularity finer than one day - fetchSDA() extensions for better handling of components with no horizon data - SDA_spatialQuery() and processSDA_WKT() fully use {sf}, replacing {sp} in these contexts - SDA_spatialQuery() gains argument byFeature to use multiple single-feature queries and combine the results with a unique feature ID specified by idcol argument. This allows for specific feature intersection results without secondary spatial overlay of the polygons (https://github.com/ncss-tech/soilDB/issues/222) - dbConnectNASIS() no longer requires that the NASIS credentials option be set if the dsn argument is specified. - Rebuilt loafercreek, gopheridge and mineralKing from latest fetchNASIS() results. Changes in version 2.6.9 (2021-12-03) - Replaced functionality using {plyr}/{reshape2} with {base}/{data.table} - processSDA_WKT(): replaced {rgeos} with {wk} and {sf} - SDA_spatialQuery(): added query_string argument - get_SDA_property(): fixes for MIN/MAX aggregation (https://github.com/ncss-tech/soilDB/issues/219) - get_component_from_SDA(): fragment size thresholds now conform with new (clarified) NSSH definitions Changes in version 2.6.8 - fetchNASIS() upgrades: use data.table and base internally for data aggregation - fetchNASIS("components") now "sieves" rock fragments and human artifacts using same routines as for pedons; respects nullFragsAreZero argument - fetchKSSL(..., returnGeochemicalData = TRUE) safely returns 0-length data.frame when no data available Changes in version 2.6.7 - Removed several packages from Suggests: {gridExtra}, {ggplot2}, {viridisLite}, {mapview}, {rasterVis} - get_OSD(): Handle "NA" and type conversion for JSON results an convert spaces to underscores for file names as needed - fetchSCAN(): graceful handling of timeout and converted from {plyr} to {data.table}; (https://github.com/ncss-tech/soilDB/issues/161, https://github.com/ncss-tech/soilDB/issues/184) - get_EDIT_ecoclass_by_geoUnit(): graceful handling of timeout - get_SDA_muaggatt(): add query_string argument for parity with other "SSURGO on demand" / get_SDA_*() functions Changes in version 2.6.6 - get_SDA_pmgroupname() and get_SDA_hydric() now support alternate aggregation methods. - Default for get_SDA_pmgroupname() is "dominant component", now also supports "dominant condition" and "none". - Default for get_SDA_hydric() is a map unit level aggregation of components and assigns new classes ; now supports "dominant component", "dominant condition" and "none" Changes in version 2.6.5 (2021-08-21) - API calls that return geometry in projected coordinates (AEA/NAD83) now use ESPG:5070 instead of EPSG:6350 Changes in version 2.6.4 - fetchNASIS(from="pedons") now supports fill=TRUE argument just like from="components" to include pedons that have no horizon records - createStaticNASIS(): column order should match NASIS, even if data types require reorder for ODBC driver - fetchSoilGrids() bug fixes, updates to metadata and references in documentation (https://github.com/ncss-tech/soilDB/issues/201) - Corrected the conversion factor used for predicted nitrogen values (conversion from cg/kg to g/kg) - Corrected the conversion factor used for uncertainty in bdod and nitrogen (SoilGrids uncertainty layer always uses factor of 10 to create integers) - Improved error handling - Added progress and verbose arguments for text progress bar and additional message output - Added support for {sf} and {sp} POINT geometry inputs - Add get_SDA_coecoclass() SOD-style method for mapunit/component level summaries of ecological site and other vegetation class information Changes in version 2.6.3 (2021-07-23) - SDA_query() and all functions that call SDA_query() get proper column class handling (related to #190), however: - be careful with the use of CAST(): unknown datatypes may not be correctly interpreted - previous column classes that were incorrectly guessed by type.convert() may have changed (e.g. component.wei) - SDA_spatialQuery() can now be used to return soil survey area symbols or geometry using what="areasymbol" or what="sapolygon", respectively - Added new columns to soil classification ("SC") table result of get_soilseries_from_NASIS(); now including taxonomic mineralogy class which may contain multiple parts for series with strongly contrasting control sections - Updates to get_SDA_*() methods - Extends get_SDA_property(property = ...) and get_SDA_interpretation(rulename = ...) vectorization over property/rulename to work with any aggregation method. - Now supports: Dominant Condition, Min, Max, Dominant Component, Weighted Average - Add query_string argument (default: FALSE). Set as TRUE to skip submitting query to SDA, instead returning a string of the query that would have been sent instead of data.frame result - get_SDA_property: better handling of NULL, miscellaneous areas, and property-specific weighting - Remove ISNULL(x, 0) logic that affected weighted averages in presence of missing data - Conditional calculation of horizon weights considering NULL values for requested properties (unique weights for each property) - New default argument include_minors=FALSE includes only components where majcompflag = 'Yes' in result - New default argument miscellaneous_areas=FALSE removes miscellaneous land types compkind values from result - Organic and bedrock layers are no longer removed from "Weighted Average", "MIN" or "MAX" aggregations - get_SDA_interpretation: added argument not_rated_value with default value of NA to set "not rated"" values across methods/queries. For backwards compatibility with original SQL use not_rated_value = 99.0 - Standardizing MUKEY column name (and other keys) as lowercase in results - More informative error messages for bad input / arguments inconsistent with specified method - Thanks to @hammerly who pointed out weighted averaging of NASIS phlabresults wasn't working as expected and for highlighting some more improvements (https://github.com/ncss-tech/soilDB/issues/192) - get_OSD() TXT and HTML formats now supported (in addition to JSON) through a common function interface - Added get_NASIS_table_key_by_name() get_NASIS_fkey_by_name(), get_NASIS_pkeyref_by_name(), get_NASIS_pkey_by_name(), get_NASIS_table_name_by_purpose() methods for helping get information on primary/foreign keys and thematic groups of NASIS tables (useful for creating SQLite/external snapshots of NASIS tables) - get_mapunit_from_NASIS(), get_legend_from_NASIS() and get_lmuaoverlap_from_NASIS() now works for "MLRA Survey Area" areatypename and no longer is limited by constraints on legendsuituse or mustatus Changes in version 2.6.2 (2021-05-16) - Added formativeElement argument to taxaExtent() (SoilWeb taxon extent function) - "Formative elements" are derived from the dictionary provided by the {SoilTaxonomy} package (https://cran.r-project.org/package=SoilTaxonomy) - For example: taxaExtent("abruptic", level = 'subgroup', formativeElement = TRUE) will get an 800m grid (for SSURGO data in CONUS) showing extent of taxa that have "abruptic" in subgroup-level taxon name - fetchNASIS(from="pedons") result now contains the "taxclname" (full family-level taxon name) field from the NASIS pedon table; this value is calculated based on contents of petaxhistory child table - get_SDA_interpretation and get_SDA_property now support aggregation method="NONE" allowing for returning properties, classes and ratings for individual components or horizons (https://github.com/ncss-tech/soilDB/pull/181) - ISSR800.wcs and mukey.wcs now return a result that inherits from try-error (and a message) if the Web Coverage Service query fails Changes in version 2.6.1 (2021-04-18) - Connections to local NASIS and various MS Access databases now use DBI and odbc, replacing RODBC - New methods dbConnectNASIS and dbQueryNASIS for NASIS access with read-only credentials, fetching query results, and closing the DBIConnection upon completion - NASIS methods use dsn argument to specify a local "static" SQLite file containing NASIS tables, or custom DBIConnection to a database with NASIS schema - Default dsn = NULL uses "nasis_local" ODBC connection to local NASIS SQL Server - Horizon depth logic checking is now done with aqp::checkHzDepthLogic(), powered by {data.table} - Added several new SDA query methods based on https://github.com/ncss-tech/ssurgoOnDemand by @jneme910 and @cferguso: - get_SDA_property, get_SDA_interpretation, get_SDA_muaggatt, get_SDA_hydric, get_SDA_pmgroupname Changes in version 2.6.0 - OSDquery gets a new argument (everything) for searching the entire document - fetchNASIS(..., rmHzErrors=TRUE) -- spurious removals of data due to missing "extended" records. fetchNASIS now uses aqp::horizons<- after building a minimal SoilProfileCollection from NASIS site and horizon tables. This allows aqp integrity methods to trigger where needed--preventing unintentional re-ordering or removals of "valid" horizon data. Changes in version 2.5.9 (2021-01-26) - HenryTimeLine moved to {sharpshootR} package - new functions mukey.wcs() and ISSR800.wcs() for hitting web coverage service (WCS) for gSSURGO, gNATSGO, and ISSR-800 grids - new function ROSETTA() for accessing the new ROSETTA model API (c/o Todd Skaggs, USDA-ARS) - fetchOSD(..., extended=TRUE) gains geographically associated soils, parsed from OSD (thanks AGB) - fetchSDA_spatial now can return soil survey area polygons using geom.src = "sapolygon" with x as a vector of area symbols (areasymbol) or legend keys (lkey). For sapolygon results, the method and add.field arguments work the same as for mupolygon, only now both geometries can be returned with fields from the legend table. - fetchSDA_spatial now can return STATSGO gsmmupolygon geometry with db = "STATSGO"; these data are linked to mapunit and (national) legend just like mupolygon. Changes in version 2.5.8 (2020-10-21) - fetchNASIS / soilDB:::.rockFragmentSieve now uses fragment RV, soilDB:::.sieve uses < operator (https://github.com/ncss-tech/soilDB/issues/1) - fetchKSSL(..., returnMorphologicData=TRUE) now returns redoximorphic features by horizon - new function taxaExtent returns 800m gridded taxonomic grids for CONUS - seriesExtent can now return 800m gridded series extents for CONUS - SDA_spatialQuery can now retrieve SSURGO and STATSGO geometry c/o dschlaep (https://github.com/ncss-tech/soilDB/issues/141) - new import: data.table; beginning to implement data.table-aware methods in aqp and soilDB Changes in version 2.5.7 - add fetchGDB for querying tabular data from SSURGO/gNATSGO/STATSGO File Geodatabases - add get_NOAA_GHCND() and get_NOAA_stations_nearXY() for batch queries of NOAA Daily Climate Data (requires free API token) - bug fix for fetchSDA_spatial with chunk.size > 1 resulting in duplicate data in result - major improvements to fetchSDA_spatial to handle queries that exceed JSON Serialization Limit - add fetchSoilGrids for point data queries to SoilGrids v2 API with SoilProfileCollection output - fetchKSSL(..., returnGeochemicalData=TRUE) now returns geochemical, optical and XRD/thermal data Changes in version 2.5.6 - bug fixes in fetchKSSL related to vectorization, all arguments vectorized except for bbox - KSSL_VG_model output cleaned-up, now returns phi -> theta function Changes in version 2.5.3 - fetchKSSL is now fully vectorized and builds on new SoilWeb JSON API Changes in version 2.5.2 - add get_concentrations_from_NASIS_db() and get_phfmp_from_NASIS_db() for fetching Pedon Horizon Concentrations and Field Measured Properties from NASIS local database Changes in version 2.5.1 - bug fix for fetchNASIS(from='components', fill=TRUE, rmHzErrors=TRUE) in context of new ::hzDepthTests() and non-unique chiid due to NA values introduced by fill Changes in version 2.5 (2020-01-28) - CRAN release - simplifyColorData and mix_and_clean_colors always use CIELAB colorspace for weighted averages, and best-available metric for transformation to Munsell notation - fetchSDA_spatial - new fetch function that simplifies getting spatial data associated with a vector of mukey or nationalmusym. The function has options for customizing result attribute table and is designed to automatically use makeChunks() to prevent timeout on large queries. - aqp::test_hz_logic is now deprecated -- refactored affected fetch functions Changes in version 2.4.3 - surface water depth added to fetchNASIS_pedons() - fetchNASIS() has @restrictions set automatically if data are populated - new function for accessing pedon RMF in local NASIS DB: get_RMF_from_NASIS_db() Changes in version 2.4 - CRAN release (https://github.com/ncss-tech/soilDB/releases/tag/2.4) - documentation updates Changes in version 2.3.9 - SDA_query() no longer writes temporary files, c/o suggestion from Kyle Bocinsky (#106 / #108) - fetchOSD() gets a sanity check to protect against going over GET request limits - makeChunks() added to util functions, useful for splitting data before sending API calls Changes in version 2.3.8 - loafercreek, gopheridge, and mineralking sample data have been updated with valid place-holder in @sp - bug fix for SDA_query() related to multi-line records (https://github.com/ncss-tech/soilDB/issues/28) Changes in version 2.3.7 - sharpshootR added to SUGGESTS - fetchHenry() and fetchSCAN() now include water year/day (Oct 1 -- Sep 30) - HenryTimeLine() convenience function added - bug fix in fetchOSD(..., extended=TRUE) when no climate data available - bug fix in SDA_query() Changes in version 2.3.6 - simplifyFragmentData() and related functions now 4-5x faster - fetchOSD() now returns metadata when extended=TRUE Changes in version 2.3.5 (2019-01-14) - NAMESPACE and R CMD check fixes - documentation updates - soilDB now suggests stringr - new tests - release to CRAN Changes in version 2.3.3 - bug fix in fetchNASIS() related to conversion of NULL fragment volume to 0 - fetchKSSL() can now automatically simplify colors with simplifyColors = TRUE Changes in version 2.3 (2018-11-19) - new function for exploring soil series co-occurrence data: siblings() - fetchOSD(..., extended=TRUE) gets competing soil series - new tests - removed old sample gSSURGO chunk and related documentation - release to CRAN Changes in version 2.2-6 - new function for spatial queries: SDA_spatialQuery(), still needs testing and documentation - fetchOSD() gets an overhaul, new API and features Changes in version 2.2-5 - experimental interface to SoillWeb OSD fulltext search: OSDquery() Changes in version 2.2-4 - numerous bug-fixes in simplifyFragmentData() see (https://github.com/ncss-tech/soilDB/issues/70) Changes in version 2.2-1 - get_mutext_from_NASIS_db() added for extraction of map unit text notes Changes in version 2.2 - CRAN release - better bug-fix for fetchSCAN and missing data (https://github.com/ncss-tech/soilDB/issues/26) - exposing some of the internal functionality used by fetchHenry Changes in version 2.1-1 - added more SCAN/SNOTEL metadata (https://github.com/ncss-tech/soilDB/issues/61) Changes in version 2.1 - generalized local NASIS ODBC authentication, should work on windows 7, 8, 10 https://github.com/ncss-tech/soilDB/issues/54 Changes in version 2.0-4 - bug fix for subtle change in how SCAN data are returned from webservice Changes in version 2.0-3 - bug fix for simplifyFragmentData(, nullFragsAreZero=FALSE), still more work to do Changes in version 2.0-2 - bug fix for simplifyFragmentData() when fragment volume > 100% Changes in version 2.0-1 (2018-01-23) - updated loafercreek and gopheridge sample datasets and manual page to reflect latest fetchNASIS Changes in version 2.0 (2018-01-11) - bug fixes, manual page updates, and stabilization of NASIS interaction - released to CRAN Changes in version 1.8.12 - bug fix in fetchHenry(), it is now possible to query only sensor metadata Changes in version 1.8.11 - temporary bug-fix related to SCAN data (https://github.com/ncss-tech/soilDB/issues/26) Changes in version 1.8-10 - converting all URLs to 'HTTPS', addressing bugs with fetchSCAN() and associated functions Changes in version 1.8.10 - re-write of mix_and_clean_colors() so that color mixing happens in CIE LAB space Changes in version 1.8-7 (2016-11-10) - sanity checks for fetchHenry() - SCAN_sensor_metadata() vectorized and documented - unique row names in SPDF returned by seriesExtent() Changes in version 1.8-6 - converted all links to SoilWeb servers to HTTPS - converted all NRCS web-service links to HTTPS Changes in version 1.8.5 - re-write of SDA_query(), better error handling, support for multi-part result sets Changes in version 1.8-4 - fetchOSD() now returns dry colors and the source "narrative" for each horizon; function gains an argument - fetchOSD() now returns texture class, coarse fragment modifier, pH, and pH class - fetchSCAN() re-written, see manual pages and http://ncss-tech.github.io/AQP/soilDB/fetchSCAN-demo.html Changes in version 1.8.2 - fetchHenry() can now access water level data, see manual page Changes in version 1.8.1 - new function: get_comonth_from_NASIS_db() see manual page for details Changes in version 1.8 (2016-04-29) - fetchKSSL() can now query basic morphologic data with the argument "returnMorphologicData" - two new functions for simplifying NASIS color and fragment data: - simplifyFragmentData() - simplifyColorData() - ^^^ these new functions are now used by fetchNASIS() to summarize color and fragment data (vs. SQL) - NOTE: soilDB now uses reshape2::dcast() instead of reshape::cast() Changes in version 1.7 (2016-02-16) - bug fix in colors returned by fetchNASIS(), reported by Andy Paolucci - bug fix in SDA_query(), due to changes in httr::content. Thanks Kyle Bocinsky for the fix! - SDA_query() now returns SQL errors generated by SDA - new columns from NASIS site table returned by fetchNASIS() - NASIS pedon ecosite data now returned by fetchNASIS() (c/o J. Skovlin) Changes in version 1.6.9 - clean-up in local NASIS queries, removed extra parentheses - NASIS component query function overhaul: previous code may be broken, details pending Changes in version 1.6.8 - added temperature class (temp_class) field from the pedon taxonomic history table (NASIS) [addition suggested by J. Baker] Changes in version 1.6.7 - experimental function for processing SDA queries that return geometry: processSDA_WKT() Changes in version 1.6.5 - bug fix for poorly specified geomorphic descriptions, caused fetchNASIS() to barf - fetchKSSL() gains new query filters, see man page Changes in version 1.6.4 - package re-org, getting ready for soilDB 2.0: + dropping use of RCurl functions in favor of httr alternatives (done) + switch from reshape to reshape2 (pending) + possibly move some packages from SUGGESTS to IMPORTS Changes in version 1.6.3 - new spatial query helper functions for SDA - re-named SSURGO_spatial_query() to SoilWeb_spatial_query(), this function may be phased-out due to spatial support now available in SDA - removed MUKEYS_by_ll_bbox() function, no longer needed and web-service may be disabled at any time - mapunit_geom_by_ll_bbox() will probably be removed in the near future with an SDA-based alternative - KSSL data updated (server-side) to June 2015 snapshot, "site_id" column removed from fetchKSSL() results Changes in version 1.6 - soilDB now imports from the reshape package, will transition to reshape2 with soilDB 2.0 - fetchHenry() officially added, complete with documentation - SDA_query() undergoing some upgrades, no longer requires SSOAP / XMLSchema packages - SSOAP / XMLSchema packages no longer in 'suggests' list Changes in version 1.5-8 - fetchKSSL() gets an argument for downloading data by MLRA Changes in version 1.5-7 - updated the loafercreek and gopheridge sample datasets Changes in version 1.5-3 - nullFragsAreZero argument to fetchNASIS() reset to TRUE, new documentation pending - consolidate of messages printed when running fetchNASIS() - introduction of new option "soilDB.verbose" (default is FALSE) for increasing the level of QC information printed - new tutorial on fetchNASIS() Changes in version 1.5-2 (2015-02-25) - RODBC temporarily moved from "suggested" package to "imported" package... not a good idea, reverted to "suggested" Changes in version 1.4-5 - mix_and_clean_colors() now returns back-transformed, mixed, munsell colors - added psctopdepth and pscbotdepth back to extended NASIS query (particle size control section depths) Changes in version 1.4-3 - get_hz_data_from_NASIS_db() no longer assumes fragment volume of NULL = 0 - get_extended_data_from_NASIS_db() no longer assumes fragment volume of NULL = 0 - fetchNASIS() has a new argument, nullFragsAreZero=FALSE; set to TRUE for past NULL -> 0 conversion Changes in version 1.4-2 - new internally-used function .formatLandformString() for flattening NASIS/PedonPC "landform" records - new internally-used function .formatParentMaterialString() for flattening NASIS/PedonPC "parent material" records - fetchNASIS() incorporates the results of these two new functions - new function SSURGO_spatial_query() queries SSURGO data from SoilWeb (see manual page for details) Changes in version 1.4 - moving most of the hard-to-install packages into suggests, and checking for package availability at function runtime. this will make soilDB more portable, as not every user will want or need all functionality. Changes in version 1.3-6 - fetchNASIS() gains argument rmHzErrors to optionally retain pedons with horizonation errors. use with caution. Changes in version 1.3-5 - loafercreek sample dataset re-created from new data - seriesExtent() now utilizes pre-cached GeoJSON files from [http://casoilresource.lawr.ucdavis.edu/see/] Changes in version 1.3 - Changes made to fetch functions to accommodate changes implemented in the NASIS 6.3 data structure - get_site_data_from_NASIS_db(): in cases where multiple records in site-bedrock exist, retain only the most shallow - fetchRaCA() has a new argument for querying data by rcasiteid Changes in version 1.2-9 - SOC concentration and stock values are temporarily disabled in fetchRaCA() + waiting for new estimates from the Soil Survey Center... Changes in version 1.2-6 (2013-12-17) - added new function contributed by J.M. Skovlin: get_veg_from_NPS_PLOTS_db() - bug fixes in get_extended_data_from_NASIS_db(): results from geomorph tables are now returned Changes in version 1.2-3 - added new function fetchSCAN() for downloading soil/climate data from USDA-NRCS SCAN stations (still experimental!) Changes in version 1.2-1 - bug fixing in fetchRaCA(): + "#" characters no longer cause errors + duplicate IDs in source data have been fixed Changes in version 1.2 - fetchRaCA() function now stable, ready for general usage - fixed bug in fetchRaCA() function where the presence of single-quote character in horizon designation would throw and error Changes in version 1.1-3 - new function get_copedon_from_NASIS_db(): returns basic information associated with pedons linked to component data in NASIS - new function fetchRaCA(): gets data from the Rapid Carbon Assessment project [work in progress] Changes in version 1.1 - get_site_data_from_NASIS_db() no longer has problems when more than 1 site bedrock kind is defined; only the shallowest row is returned Changes in version 1.0 (2013-04-18) - fetchNASIS() is now much more efficient: faster / less memory used - new function! fetchKSSL(): experimental interface to (most of) the KSSL data - queries can be performed by series name or GCS bounding box - data are delivered via CA Soil Resource Lab server Changes in version 0.9-8 - fetchOSD() now immune to queries for non-soils - improved efficiency in fetch* functions - NASIS-DMU fetching functions now return more information, still not as complete as pedon-queries Changes in version 0.9-7 - NASIS query functions now return only records from the selected set, please test older code! Changes in version 0.9-6 (2013-02-28) - new function get_text_notes_from_NASIS_db() -- still needs proper documentation - bug fixes to PedonPC and NASIS queries, new data elements returned by extended query functions - SoilWeb queries via URL are now URL-encoded to allow for spaces in soil series names Changes in version 0.9-4 - new function: fetchOSD() returns basic OSD data as a SoilProfileCollection Changes in version 0.9-3 (2013-01-10) - speed-bump in color-fetching functions from NASIS/pedonPC - fetchNASIS() now attempts to correct for >1 pedon/site by appending peiid to pedon_id Changes in version 0.9-2 - new functions for getting / plotting the geographic extent of a soil series, using the SoilWeb query service: +seriesExtent() : fetches extent as a SpatialPolygonDataFrame +seriesExtentAsGmap() : fetches extent and plots on Google Maps (requires dismo package) Changes in version 0.9-1 - updated functionality in fetchNASIS_component_data() pulls mapunit-level data as well as component-level data - Munsell 'value' is now returned from PedonPC/NASIS fetching functions Changes in version 0.9 - added a surface fragment summary "surf_frag_summary" to the results of get_extended_data_from_NASIS() + note: this has not been ported to the related PedonPC queries - integrated surf_frag_summary data into data returned from fetchNASIS(), stored in @site - note: this has not been ported to the related PedonPC queries - minor bug-fix in horizon-level rock fragment summary SQL which previously mis-classified BD as ST in some, rare cases - note: this has not been ported to the related PedonPC queries Changes in version 0.8-3 (2012-10-10) - site-level data: {elev, slope, aspect} are now named {elev_field, slope_field, aspect_field} + this affects the data returned by fetchNASIS() and fetchPedonPC() Changes in version 0.8-2 - compatible with NASIS 6.2 - bug fixes - taxhistory selection method is preserved in the results - 'taxonname' is used instead of 'sampled_as' / 'correlated_as, seems to work, but needs further testing Changes in version 0.8 - updating for PedonPC 5.0 and NASIS 6.2 + site data contains the best-guessed corresponding row from the taxhistory table, based on: 1) most recent record, or 2) record with the least amount of missing data + taxhistory data are now included in the output from get_extended_data_from_pedon_db() - package is now partially compatible with NASIS 6.2 Changes in version 0.6 - tidying up documentation, package dependencies, and NAMESPACE Changes in version 0.5-6 - adding preliminary functions for querying component data from local NASIS - fixed minor bug in SDA_query() and added some links to related documentation Changes in version 0.5-1 - fetchNASIS() and fetchPedonPC() now integrate `extended' data - warning and error messages cleaned-up - multiple textures no longer cause duplicate HZ rows (NASIS only) - extended queries now split frags/para-frags - silt fraction is estimated from 100-(sand+clay) when possible - added local NASIS ODBC connection vignette (thanks JMS) - removed dsn argument from NASIS functions as it should always be 'nasis_local' - new wide-formatted, boolean representation of diagnostic horizon data - queries standardized between NASIS/PedonPC - new fetchNASIS() function for 1-line access to local NASIS data - new sample data set 'loafercreek' - basic vignette added, switching to knitr-style vignettes Changes in version 0.3-3 (2012-01-16) - SDA_query() now functional on MacOS/UNIX-like OSes with (SSOAP 0.8-1, XMLSchema 0.6-0, and XML 3.7-1), thanks to D.T. Lang for the updates! - moving hard to find packages to 'suggested' status: SSOAP, RCurl, XML, rgdal - new wrapper function fetchPedonPC() for typical site/pedon/hz queries - new function getHzErrorsPedonPC() for ID-ing pedons with problem horizonation - NOTE: hz data queries will return 2 rows/hz (error) when multiple texture classes are assigned to a single horizon- this is a bug, not a feature! Changes in version 0.3-2 (2012-01-03) - NASIS/pedonPC queries synced - minor bug fixes and documentation updates - updated query structure, switching over to native NASIS/PedonPC IDs - extended summaries added: NASIS only Changes in version 0.2 - moved functions out of aqp package - basic query functionality from local NASIS DB (Jay) Changes in version 0.1 - initial version on r-forge - functions still exist in aqp package... need to move over completely