Commit Graph

5475 Commits

Author SHA1 Message Date
Jordan Henderson
16507a763a Add mechanism for determining if a chunk is being fully overwritten 2017-01-30 12:22:16 -06:00
Jordan Henderson
79220e9665 Add back debugging statements
Move conditional check inside while loop in
construct_filtered_io_info_list
2017-01-30 08:20:15 -06:00
Jordan Henderson
5ed72c3d41 Remove Debugging Statements for Code Review 2017-01-27 10:52:17 -06:00
Jordan Henderson
0a93759774 Remove unnecessary num_chunks_selected_array from
H5D__construct_filtered_io_info_list
2017-01-27 09:06:56 -06:00
Jordan Henderson
344781f17d Multiple Bug Fixes
Add comments explaining different variables

Check more overflow/conversion sign change issues
2017-01-26 14:03:36 -06:00
Jordan Henderson
0b6016a3fc Fix bug with chunk data updating 2017-01-25 19:34:10 -06:00
Jordan Henderson
aab742c9a2 Test code for sending chunk modification data around 2017-01-24 15:01:31 -06:00
Jordan Henderson
b19b0ea67d Clean up H5Dmpio.c warnings 2017-01-20 14:09:20 -06:00
Jordan Henderson
5426599c91 For sake of complexity, force multi chunk IO for parallel filtered read 2017-01-19 14:32:17 -06:00
Jordan Henderson
740e85a82d Code refactoring
Modify single chunk entry function to handle both read and write cases

Store array of MPI derived types in Multi-chunk IO so that all freeing
can be done at end instead of during processing

Add read support for Multi-chunk IO only currently
2017-01-19 11:54:07 -06:00
Jordan Henderson
2c8bddb4ab Clean up const and other warnings
Add notes about need for another minor error code
2017-01-18 17:36:07 -06:00
Jordan Henderson
9bb49c6b05 Update documentation for link and multi chunk IO 2017-01-18 17:09:17 -06:00
Jordan Henderson
4a83ceaf7d Major cleanup
Separate update phase for chunk entry into its own function, since code
for multi-chunk IO and link-chunk IO is exactly the same

Remove last IO mode code from multi-chunk IO, since filtered collective
writes cannot break to independent IO mode

Fix collective overlapping IO for multi-chunk IO by iterating equal to
the max number of chunks on any process

Make hard separation between collective read and write since trying to
mix the two into one loop becomes messy

Add preliminary code for asynchronous sending of chunk modification data
to new owning process when redistributing chunks
2017-01-18 16:48:27 -06:00
Jordan Henderson
349b3634f7 Add chunk redistribution for shared chunks
Remove check for process having a selection as this needs to be reworked
2017-01-17 14:39:41 -06:00
Jordan Henderson
2292a8520d Eliminate owner field
Work on redistributing shared chunks
2017-01-13 14:21:59 -06:00
Jordan Henderson
a3605cbdeb Switch working branch from master to develop 2017-01-13 08:14:38 -06:00
Quincey Koziol
8d4c84eae2 Bring changes to metadata cache "get entry status" call and new
"child serialized / unserialized" messages and support from the cache image
branch.
2017-01-06 11:37:17 -08:00
Quincey Koziol
7568dcaf15 Add "image up to date" flag / parameter to metadata cache entry status calls. 2017-01-06 07:51:40 -08:00
Quincey Koziol
afd7e5b476 Bring file shutdown code from cache image branch 2017-01-04 21:36:14 -08:00
Quincey Koziol
6232dd6d62 Merge code from cache image branch to split FSM ring into two types: raw data
and metadata.  Also, some more ring reset safeties and minor code cleanups.
2017-01-04 09:20:01 -08:00
Quincey Koziol
15f474ee0d Align w/incoming cache image changes, and improve recovery on errors. 2017-01-04 08:11:44 -08:00
Quincey Koziol
363c140661 Revert accidental changes to freespace open and close routines. 2017-01-03 08:34:33 -08:00
Quincey Koziol
e73a32b852 Remove 'const' from cache client pre_serialize callback, to reduce warnings,
and correspondingly remove 'const' from some internal routines.  Also rename
some H5MF* routines to reflect their static/package usage.
2017-01-03 08:28:05 -08:00
Quincey Koziol
edd3ff3098 Merge branch 'develop' of https://bitbucket.hdfgroup.org/scm/hdffv/hdf5 into develop_merge_cache_image_04 2017-01-02 12:09:34 -08:00
Quincey Koziol
ce3877d298 Align with incoming cache_image branch changes: use the index list (instead of
the hash buckets) for scanning the entries during a flush, and also add in
counters for tracking operations during cache flushes.
2017-01-02 12:06:08 -08:00
Dana Robinson
54629912eb Fixed a macro in H5Cpkg.h that was only updated in the version that
is used in develop/debug mode.
2017-01-01 23:30:48 -05:00
Quincey Koziol
0610c41c75 Bring support for doubly-linked list of all entries in cache from incoming
cache image branch.
2016-12-30 02:22:48 -08:00
Quincey Koziol
e500f2d3da Align with name change of "user" ring in incoming cache image changes. 2016-12-30 02:22:00 -08:00
Quincey Koziol
eecc0a26ef Refactor several cache clients to have only one copy of their deserialization
code.
2016-12-30 00:50:05 -08:00
Dana Robinson
5e26cd2d82 Merge pull request #223 in HDFFV/hdf5 from develop_merge_cache_image_02 to develop
Merged normalizations w/ cache_image branch.

* commit 'da2f1610d1f2cba40770aee6d0d6fbc8196645ae':
  More normalizations against incoming cache image branch.
2016-12-29 09:43:39 -06:00
Dana Robinson
890e1f3263 Merge pull request #200 in HDFFV/hdf5 from ~DEROBINS/hdf5_der:name_macros to develop
Merged naming check improvement in function enter macros.

* commit '441c8ea43ab6a6559d1f167bdfbbaf3720621804':
  Added text to the function check macros so that a more helpful error message is emitted when there is a problem.
2016-12-29 09:42:49 -06:00
Dana Robinson
affa32b149 Merge pull request #222 in HDFFV/hdf5 from ~DEROBINS/hdf5_der:H5Odtype_tidy to develop
H5Odtype tidy.

* commit 'a25a08dff04c4ba03f28e8219a2ea782cf33d466':
  Cleaned up H5Odtype.c
2016-12-29 05:57:48 -06:00
Quincey Koziol
da2f1610d1 More normalizations against incoming cache image branch. 2016-12-29 02:40:26 -08:00
Dana Robinson
a25a08dff0 Cleaned up H5Odtype.c 2016-12-29 03:05:39 -05:00
Quincey Koziol
9e6a5a5f2c Normalize against incoming cache image feature. 2016-12-28 11:36:32 -08:00
Quincey Koziol
f8cfbee05e Merge SWMR-related testing to existing tests. 2016-12-18 02:19:26 -08:00
hdftest
e0b353b6f5 Snapshot version 1.9 release 235 2016-12-16 15:23:58 -06:00
Dana Robinson
441c8ea43a Added text to the function check macros so that a more helpful
error message is emitted when there is a problem.
2016-12-12 18:25:34 -05:00
Allen Byrne
ae59766fc9 Change dlopen from RTLD_NOW to RTLD_LAZY 2016-12-12 17:08:01 -06:00
Dana Robinson
651c2f3030 Fix bad implementation of Windows nanosleep equivalent. 2016-12-12 14:16:07 -05:00
Quincey Koziol
46754fec41 Merge pull request #194 in HDFFV/hdf5 from ~KOZIOL/hdf5:develop_swmr_merge_03 to develop
* commit 'feb9d1f6761b541a388100d04ec56a9b88a7e462':
  Bring over changes from revise_chunks that cleanup recent SWMR changes from code review feedback.
2016-12-12 09:24:42 -06:00
Dana Robinson
652e02db4e Removed NDEBUG guards from H5AC test functions.
H5AC_dump_cache() is now used in test/cache_tagging.c and the
underlying H5C functions are not protected by NDEBUG guards.
2016-12-11 14:46:32 -05:00
Quincey Koziol
feb9d1f676 Bring over changes from revise_chunks that cleanup recent SWMR changes from
code review feedback.
2016-12-11 00:28:05 -08:00
Dana Robinson
cc6eb939f4 Merge pull request #191 in HDFFV/hdf5 from ~DEROBINS/hdf5_der:eoc_h5fs_fix to develop
Final fix for evict-on-close issues with new-style groups.

* commit '02879bc4b2ba161dc259bf28a71e7a99b44be0e3':
  Updated the H5FS cache code to grab the correct tag and modified the freespace test to use dxpls that have been tagged with the H5AC__FREESPACE_TAG global tag instead of H5AC_ind_read_dxpl_id. The library code now expects the owner of the free space manager to tag it so the owner-less free space managers in the freespace tag had to be tagged with *something* to avoid cache errors.
  Changed the name of H5MF_alloc_close() to H5MF__alloc_close() to make the FUNC_ENTER macro happy.
  Reverted the freespace test. The TAG macros in H5MF_get_freespace() make the changes unnecessary.
  Added missing TAG macros to H5MF_get_freespace().
  Updated the freespace test so functions take a common, tagged dxpl so the test will work with the new H5FS tag changes.
  Updated the cache_tagging test so it correctly analyzes the new fractal heap free space manager behavior.
  Added TAG macros to the H5MF package code so H5AC__FREESPACE_TAG gets set on the dxpl correctly. Also restored the TAG macro to H5FS__cache_hdr_pre_serialize() since otherwise the tag won't be initialized.
  First cut at fixing the tagging issue with the free space managers. * Converted the tag macros to regular ones so the parent's tag   is used via the dxpl.
2016-12-10 08:09:40 -06:00
Dana Robinson
02879bc4b2 Updated the H5FS cache code to grab the correct tag and modified
the freespace test to use dxpls that have been tagged with
the H5AC__FREESPACE_TAG global tag instead of H5AC_ind_read_dxpl_id.
The library code now expects the owner of the free space manager
to tag it so the owner-less free space managers in the freespace
tag had to be tagged with *something* to avoid cache errors.
2016-12-07 21:16:12 -05:00
Dana Robinson
16a5c7c8f3 Merge branch 'develop' into eoc_h5fs_fix 2016-12-07 17:21:07 -05:00
Dana Robinson
0f2f51bb7b Updated the comment for the valgrind fix. 2016-12-06 19:44:18 -05:00
Dana Robinson
a366c0a492 Fixed a valgrind problem in file shutdown exposed by the swmr.c test. 2016-12-06 19:03:00 -05:00
Quincey Koziol
e1026bd354 Correct oversight in Java test and remove direct VFD from SWMR supported
drivers.
2016-12-02 11:36:27 -08:00
Quincey Koziol
15e04901a0 Merge branch 'develop' of https://bitbucket.hdfgroup.org/scm/~koziol/hdf5 into develop_swmr_merge 2016-12-02 08:08:49 -08:00