Add check for valid Socrata resource URL. Add check for supported download file format. Add support for Socrata short dates.
Use comma-separated file format for Socrata downloads.
-
Added support for human-readable URL. Users can now copy and paste URLs of Socrata-hosted datasets, which will be transformed into a valid SoDA API web query.
-
Added additional RUnit tests to validate new functionality.
Add json file format for Socrata downloads. Switch to RJSONIO
from rjson
.
- Swapped to
jsonlite
fromRJSONIO
- Added handling for long and short dates
- Added unit test for reading private datasets
Deprecated httr::guess_media()
and implemented mime::guess_type()
- New function,
ls.socrata
to list all datasets on a Socrata portal. - New optional argument,
app_token
, which lets users supply an API token while usingread.socrata()
to minimize throttling. - Repairs a bug where
read.socrata
failed when reading in a date with a column, but there are null values in that column. - Minor changes to the DESCRIPTION documentation to point users to GitHub for issues and provides new contact information.
- Resolved potential name collision issue
- Cleaned-up documentation with contributor instructions #23 and #28)
- Moved test coverage in
RUnit
totestthat
and implemented code coverage monitoring (#41) - Clean-up DESCRIPTION (#40)
- Add continuous integration for Windows (#39)
- Migrate Travis-CI to "proper" R YAML (#46)
New features:
- Users can upload data with
write.socrata()
to upload data to Socrata data portals (using "upsert" and "replace" methods). - Download private datasets by using Socrata credentials with
email
andpassword
fields inread.socrata()
.
Bug fixes:
- Updated unit testing on
ls.socrata()
to check for@type
field is available. - Converts a Socrata money field into a proper numeric field, instead of a factor.
- Updated build method for Travis to test using the current CRAN packages, not beta packages from GitHub.
- Users provided an option to handle string-like fields as characters (chr) or factors. Default is to handle string-like fields as character vectors (#27)
- Fixes bug where dates are incorrectly read when first date is a blank (#68)
- Dates are now handled using
POSIXct
instead ofPOSIXlt
(#8) - Added additional unit testing (#28)
- Artifacts from Appveyor CI can now be directly submitted to CRAN (#77)
- Fixed issue where JSON may occasionally come back with a final NULL that is not "[]" (in this example it was "[]\n"). This caused
getDataFrame
to get stuckin an infinite loop while waiting for "[]". Thank you @kevinsmgov for documenting this bug in issue (#96) - Resolved an error users would see when downloading the JSON file on a SoDA call,
Error in rbind(deparse.level, ...) : numbers of columns of arguments do not match
. (#19) - The LIMIT argument was incorrectly interpreted by RSocrata, which sometime causes slower performance (#83, #14)
- The mandatory
@context
,@id
,conformsTo
, anddescribedBy
fields were not shown when usingls.socrata()
. These elements are now included as attributes in the resulting data frame. (#72) - Fixed a bug which a user-defined token was ignored when the user passed along a
$where
argument in a SoDA query. (#105) - Fixes a bug where the POSIX date conversion would not occur when using the JSON SoDA url (#85)
- Queries now follow SoDA guidelines and are explicitly sorted. This could have caused a silent error where some row may not have downloaded. (#15)
Performance improvements:
- By default, 1000 rows at a time were being retreived for each API call while paging through data. Increased to retreive 50,000 rows for each API call. (#129)
Bug fixes:
- Fixed a bug which caused an error if a
select=count()
statement was present in a URL. (#120) - Fixed a bug when data types are not found because there are no
X-SODA2-*
headers available in the API response. Users will now get a warning and data will be returned ascharacter
. (#118) - Fixed a bug which did not recognize URLs listed from
ls.socrata()
as valid URLs to be used inread.socrata()
. Users will now be able to use URLs from the former function in the latter function. (#124) - Removed unit tests for older releases of R. (#136)
Deprecation:
RSocrata's core development team has stated a formal policy to only support the most recent release of R. Until now, RSocrata was tested against the penultimate release of R; however, testing will be limited to the current version of R and the current development release. The project's contributing guidelines have been updated to reflect that accepted changes to RSocrata must pass tests on the current and penulimate versions of R.
While RSocrata is only tested on the current and penultimate version, the core development team expects it will work on older versions most of the time. See #132 for more information.
CRAN bug fixes
The updates from 1.7.8 to 1.7.9 are all realated to minor bug fixes to pass CRAN tests, which were caused by changes by the data portal vendor.
- Tests have been updated to reflect changes in the order in which columns are returned
- Tests have been skipped to reflect the vendor's deletion of user accounts that are consistent with their security policy.