1. 24 Jul, 2014 7 commits
    • Robert Haas's avatar
      Prevent shm_mq_send from reading uninitialized memory. · 1144ea34
      Robert Haas authored
      shm_mq_send_bytes didn't invariably initialize *bytes_written before
      returning, which would cause shm_mq_send to read from uninitialized
      memory and add the value it found there to mqh->mqh_partial_bytes.
      This could cause the next attempt to send a message via the queue to
      fail an assertion (if the queue was detached) or copy data from a
      garbage pointer value into the queue (if non-blocking mode was in use).
      1144ea34
    • Robert Haas's avatar
      Fix checkpointer crash in EXEC_BACKEND builds. · 250c26ba
      Robert Haas authored
      Nothing in the checkpointer calls InitXLOGAccess(), so WALInsertLocks
      never got initialized there.  Without EXEC_BACKEND, it works anyway
      because the correct value is inherited from the postmaster, but
      with EXEC_BACKEND we've got a problem.  The problem appears to have
      been introduced by commit 68a2e52b.
      
      To fix, move the relevant initialization steps from InitXLOGAccess()
      to XLOGShmemInit(), making this more parallel to what we do
      elsewhere.
      
      Amit Kapila
      250c26ba
    • Andres Freund's avatar
      Properly remove ephemeral replication slots after a crash restart. · 93a028f5
      Andres Freund authored
      Ephemeral slots - slots that shouldn't survive database restarts -
      weren't properly cleaned up after a immediate/crash restart. They were
      ignored in the sense that they weren't restored into memory and thus
      didn't cause unwanted resource retention; but they prevented a new
      slot with the same name from being created.
      
      Now ephemeral slots are fully removed during startup.
      
      Backpatch to 9.4 where replication slots where added.
      93a028f5
    • Robert Haas's avatar
      Avoid access to already-released lock in LockRefindAndRelease. · 32d78894
      Robert Haas authored
      Spotted by Tom Lane.
      32d78894
    • Robert Haas's avatar
      docs: Improve documentation of \pset without arguments. · 967a4e7f
      Robert Haas authored
      The syntax summary previously failed to clarify that the first
      argument is also optional.  The textual description did mention it,
      but all the way at the bottom.  It fits better with the command
      overview, so move it there, and fix the summary also.
      
      Dilip Kumar, reviewed by Fabien Coelho
      967a4e7f
    • Fujii Masao's avatar
      Fix bug where pg_receivexlog goes into busy loop if -s option is set to 0. · 78493b71
      Fujii Masao authored
      The problem is that pg_receivexlog calls select(2) with timeout=0 and
      goes into busy loop when --status-interval option is set to 0. This bug
      was introduced by the commit,
      74cbe966.
      
      Per report from Sawada Masahiko
      78493b71
    • Peter Eisentraut's avatar
      Fix TAP installcheck tests when current directory name contains spaces · 455044d5
      Peter Eisentraut authored
      This fixes the installcheck part.  The check part has additional
      problems that will be addressed in a separate commit.
      455044d5
  2. 23 Jul, 2014 3 commits
    • Tom Lane's avatar
      Rearrange documentation paragraph describing pg_relation_size(). · 4fd9e6ff
      Tom Lane authored
      Break the list of available options into an <itemizedlist> instead of
      inline sentences.  This is mostly motivated by wanting to ensure that the
      cross-references to the FSM and VM docs don't cross page boundaries in PDF
      format; but it seems to me to read more easily this way anyway.  I took the
      liberty of editorializing a bit further while at it.
      
      Per complaint from Magnus about 9.0.18 docs not building in A4 format.
      Patch all active branches so we don't get blind-sided by this particular
      issue again in future.
      4fd9e6ff
    • Noah Misch's avatar
      Report success when Windows kill() emulation signals an exiting process. · 0ea1f2a3
      Noah Misch authored
      This is consistent with the POSIX verdict that kill() shall not report
      ESRCH for a zombie process.  Back-patch to 9.0 (all supported versions).
      Test code from commit d7cdf6ee depends
      on it, and log messages about kill() reporting "Invalid argument" will
      cease to appear for this not-unexpected condition.
      0ea1f2a3
    • Noah Misch's avatar
      MSVC: Substitute $(top_builddir) in REGRESS_OPTS. · 31f9bbf0
      Noah Misch authored
      Commit d7cdf6ee introduced a usage
      thereof.  Back-patch to 9.0, like that commit.
      31f9bbf0
  3. 22 Jul, 2014 7 commits
    • Tom Lane's avatar
      Re-enable error for "SELECT ... OFFSET -1". · 27048980
      Tom Lane authored
      The executor has thrown errors for negative OFFSET values since 8.4 (see
      commit bfce56ee), but in a moment of brain
      fade I taught the planner that OFFSET with a constant negative value was a
      no-op (commit 1a1832eb).  Reinstate the
      former behavior by only discarding OFFSET with a value of exactly 0.  In
      passing, adjust a planner comment that referenced the ancient behavior.
      
      Back-patch to 9.3 where the mistake was introduced.
      27048980
    • Tom Lane's avatar
      Check block number against the correct fork in get_raw_page(). · 27cef0a5
      Tom Lane authored
      get_raw_page tried to validate the supplied block number against
      RelationGetNumberOfBlocks(), which of course is only right when
      accessing the main fork.  In most cases, the main fork is longer
      than the others, so that the check was too weak (allowing a
      lower-level error to be reported, but no real harm to be done).
      However, very small tables could have an FSM larger than their heap,
      in which case the mistake prevented access to some FSM pages.
      Per report from Torsten Foertsch.
      
      In passing, make the bad-block-number error into an ereport not elog
      (since it's certainly not an internal error); and fix sloppily
      maintained comment for RelationGetNumberOfBlocksInFork.
      
      This has been wrong since we invented relation forks, so back-patch
      to all supported branches.
      27cef0a5
    • Andrew Dunstan's avatar
      Allow empty string object keys in json_object(). · 4ebe3519
      Andrew Dunstan authored
      This makes the behaviour consistent with the json parser, other
      json-generating functions, and the JSON standards.
      4ebe3519
    • Noah Misch's avatar
      Diagnose incompatible OpenLDAP versions during build and test. · d7cdf6ee
      Noah Misch authored
      With OpenLDAP versions 2.4.24 through 2.4.31, inclusive, PostgreSQL
      backends can crash at exit.  Raise a warning during "configure" based on
      the compile-time OpenLDAP version number, and test the crash scenario in
      the dblink test suite.  Back-patch to 9.0 (all supported versions).
      d7cdf6ee
    • Peter Eisentraut's avatar
      Unset some local environment variables in TAP tests · 24e786f0
      Peter Eisentraut authored
      Unset environment variables that control message language, so that we
      can compare some program output with expected strings.  This is very
      similar to what pg_regress does.
      24e786f0
    • Peter Eisentraut's avatar
      gitattributes: Ignore time zone data files for whitespace checks · 8195e9e9
      Peter Eisentraut authored
      The latest update introduced some funny whitespace, but since they are
      externally maintained files, we add them to the list of files to ignore.
      8195e9e9
    • Tom Lane's avatar
      Reject out-of-range numeric timezone specifications. · 6412f3e2
      Tom Lane authored
      In commit 631dc390, we started to handle
      simple numeric timezone offsets via the zic library instead of the old
      CTimeZone/HasCTZSet kluge.  However, we overlooked the fact that the zic
      code will reject UTC offsets exceeding a week (which seems a bit arbitrary,
      but not because it's too tight ...).  This led to possibly setting
      session_timezone to NULL, which results in crashes in most timezone-related
      operations as of 9.4, and crashes in a small number of places even before
      that.  So check for NULL return from pg_tzset_offset() and report an
      appropriate error message.  Per bug #11014 from Duncan Gillis.
      
      Back-patch to all supported branches, like the previous patch.
      (Unfortunately, as of today that no longer includes 8.4.)
      6412f3e2
  4. 21 Jul, 2014 7 commits
    • Tom Lane's avatar
      212825f8
    • Tom Lane's avatar
      Adjust cutoff points in newly-added sanity tests. · 87f830e0
      Tom Lane authored
      Per recommendation from Andres.
      87f830e0
    • Tom Lane's avatar
      Defend against bad relfrozenxid/relminmxid/datfrozenxid/datminmxid values. · 78db307b
      Tom Lane authored
      In commit a61daa14, we fixed pg_upgrade so
      that it would install sane relminmxid and datminmxid values, but that does
      not cure the problem for installations that were already pg_upgraded to
      9.3; they'll initially have "1" in those fields.  This is not a big problem
      so long as 1 is "in the past" compared to the current nextMultiXact
      counter.  But if an installation were more than halfway to the MXID wrap
      point at the time of upgrade, 1 would appear to be "in the future" and
      that would effectively disable tracking of oldest MXIDs in those
      tables/databases, until such time as the counter wrapped around.
      
      While in itself this isn't worse than the situation pre-9.3, where we did
      not manage MXID wraparound risk at all, the consequences of premature
      truncation of pg_multixact are worse now; so we ought to make some effort
      to cope with this.  We discussed advising users to fix the tracking values
      manually, but that seems both very tedious and very error-prone.
      
      Instead, this patch adopts two amelioration rules.  First, a relminmxid
      value that is "in the future" is allowed to be overwritten with a
      full-table VACUUM's actual freeze cutoff, ignoring the normal rule that
      relminmxid should never go backwards.  (This essentially assumes that we
      have enough defenses in place that wraparound can never occur anymore,
      and thus that a value "in the future" must be corrupt.)  Second, if we see
      any "in the future" values then we refrain from truncating pg_clog and
      pg_multixact.  This prevents loss of clog data until we have cleaned up
      all the broken tracking data.  In the worst case that could result in
      considerable clog bloat, but in practice we expect that relfrozenxid-driven
      freezing will happen soon enough to fix the problem before clog bloat
      becomes intolerable.  (Users could do manual VACUUM FREEZEs if not.)
      
      Note that this mechanism cannot save us if there are already-wrapped or
      already-truncated-away MXIDs in the table; it's only capable of dealing
      with corrupt tracking values.  But that's the situation we have with the
      pg_upgrade bug.
      
      For consistency, apply the same rules to relfrozenxid/datfrozenxid.  There
      are not known mechanisms for these to get messed up, but if they were, the
      same tactics seem appropriate for fixing them.
      78db307b
    • Magnus Hagander's avatar
      Properly use DEFAULT_EVENT_SOURCE in pgevent.c · 4c3c911d
      Magnus Hagander authored
      This was broken and reverted in a previous commit. The (this time verified)
      fix is to simly add postgres_fe.h.
      
      MauMau, review by Amit Kapila
      4c3c911d
    • Peter Eisentraut's avatar
      Translation updates · cac0d519
      Peter Eisentraut authored
      cac0d519
    • Peter Eisentraut's avatar
      Update SQL features list · 0e819c5e
      Peter Eisentraut authored
      0e819c5e
    • Peter Eisentraut's avatar
  5. 20 Jul, 2014 2 commits
    • Tom Lane's avatar
      First-draft release notes for 9.3.5. · ddc41fd2
      Tom Lane authored
      As usual, the release notes for older branches will be made by cutting
      these down, but put them up for community review first.
      
      Note: a few of these items actually don't apply to 9.3, but only to older
      branches.  I'll sort that out when copying the text into the older
      release-X.Y.sgml files.
      ddc41fd2
    • Tom Lane's avatar
      Fix xreflabel for hot_standby_feedback. · 4cbe3abb
      Tom Lane authored
      Rather remarkable that this has been wrong since 9.1 and nobody noticed.
      4cbe3abb
  6. 19 Jul, 2014 2 commits
    • Tom Lane's avatar
      Update time zone data files to tzdata release 2014e. · b1864fab
      Tom Lane authored
      DST law changes in Crimea, Egypt, Morocco.  New zone Antarctica/Troll
      for Norwegian base in Queen Maud Land.
      b1864fab
    • Tom Lane's avatar
      Partial fix for dropped columns in functions returning composite. · 9b35ddce
      Tom Lane authored
      When a view has a function-returning-composite in FROM, and there are
      some dropped columns in the underlying composite type, ruleutils.c
      printed junk in the column alias list for the reconstructed FROM entry.
      Before 9.3, this was prevented by doing get_rte_attribute_is_dropped
      tests while printing the column alias list; but that solution is not
      currently available to us for reasons I'll explain below.  Instead,
      check for empty-string entries in the alias list, which can only exist
      if that column position had been dropped at the time the view was made.
      (The parser fills in empty strings to preserve the invariant that the
      aliases correspond to physical column positions.)
      
      While this is sufficient to handle the case of columns dropped before
      the view was made, we have still got issues with columns dropped after
      the view was made.  In particular, the view could contain Vars that
      explicitly reference such columns!  The dependency machinery really
      ought to refuse the column drop attempt in such cases, as it would do
      when trying to drop a table column that's explicitly referenced in
      views.  However, we currently neglect to store dependencies on columns
      of composite types, and fixing that is likely to be too big to be
      back-patchable (not to mention that existing views in existing databases
      would not have the needed pg_depend entries anyway).  So I'll leave that
      for a separate patch.
      
      Pre-9.3, ruleutils would print such Vars normally (with their original
      column names) even though it suppressed their entries in the RTE's
      column alias list.  This is certainly bogus, since the printed view
      definition would fail to reload, but at least it didn't crash.  However,
      as of 9.3 the printed column alias list is tightly tied to the names
      printed for Vars; so we can't treat columns as dropped for one purpose
      and not dropped for the other.  This is why we can't just put back the
      get_rte_attribute_is_dropped test: it results in an assertion failure
      if the view in fact contains any Vars referencing the dropped column.
      Once we've got dependencies preventing such cases, we'll probably want
      to do it that way instead of relying on the empty-string test used here.
      
      This fix turned up a very ancient bug in outfuncs/readfuncs, namely
      that T_String nodes containing empty strings were not dumped/reloaded
      correctly: the node was printed as "<>" which is read as a string
      value of <>.  Since (per SQL) we disallow empty-string identifiers,
      such nodes don't occur normally, which is why we'd not noticed.
      (Such nodes aren't used for literal constants, just identifiers.)
      
      Per report from Marc Schablewski.  Back-patch to 9.3 which is where
      the rule printing behavior changed.  The dangling-variable case is
      broken all the way back, but that's not what his complaint is about.
      9b35ddce
  7. 18 Jul, 2014 2 commits
    • Noah Misch's avatar
      Limit pg_upgrade authentication advice to always-secure techniques. · 85f95739
      Noah Misch authored
      ~/.pgpass is a sound choice everywhere, and "peer" authentication is
      safe on every platform it supports.  Cease to recommend "trust"
      authentication, the safety of which is deeply configuration-specific.
      Back-patch to 9.0, where pg_upgrade was introduced.
      85f95739
    • Tom Lane's avatar
      Fix two low-probability memory leaks in regular expression parsing. · 1567e659
      Tom Lane authored
      If pg_regcomp failed after having invoked markst/cleanst, it would leak any
      "struct subre" nodes it had created.  (We've already detected all regex
      syntax errors at that point, so the only likely causes of later failure
      would be query cancel or out-of-memory.)  To fix, make sure freesrnode
      knows the difference between the pre-cleanst and post-cleanst cleanup
      procedures.  Add some documentation of this less-than-obvious point.
      
      Also, newlacon did the wrong thing with an out-of-memory failure from
      realloc(), so that the previously allocated array would be leaked.
      
      Both of these are pretty low-probability scenarios, but a bug is a bug,
      so patch all the way back.
      
      Per bug #10976 from Arthur O'Dwyer.
      1567e659
  8. 17 Jul, 2014 3 commits
    • Magnus Hagander's avatar
      Revert broken change to pgevent.c · 6cd471a6
      Magnus Hagander authored
      pgevent doesn't include the global PostgreSQL headers, for a reason,
      and therefor cannot rely on defines in it...
      6cd471a6
    • Magnus Hagander's avatar
      Add option to pg_ctl to choose event source for logging · c0e4520b
      Magnus Hagander authored
      pg_ctl will log to the Windows event log when it is running as a service,
      which is the primary way of running PostgreSQL on Windows. This option
      makes it possible to specify which event source to use for this, in order
      to separate different instances. The server logging itself is still controlled
      by the regular logging parameters, including a separate setting for the event
      source. The parameter to pg_ctl only controlls the logging from pg_ctl itself.
      
      MauMau, review in many iterations by Amit Kapila and me.
      c0e4520b
    • Peter Eisentraut's avatar
      doc: Spell checking · aa688725
      Peter Eisentraut authored
      aa688725
  9. 16 Jul, 2014 2 commits
    • Heikki Linnakangas's avatar
      Fix bugs in SP-GiST search with range type's -|- (adjacent) operator. · 1264ef31
      Heikki Linnakangas authored
      The consistent function contained several bugs:
      
      * The "if (which2) { ... }"  block was broken. It compared the  argument's
      lower bound against centroid's upper bound, while it was supposed to compare
      the argument's upper bound against the centroid's lower bound (the comment
      was correct, code was wrong). Also, it cleared bits in the "which1"
      variable, while it was supposed to clear bits in "which2".
      
      * If the argument's upper bound was equal to the centroid's lower bound, we
      descended to both halves (= all quadrants). That's unnecessary, searching
      the right quadrants is sufficient. This didn't lead to incorrect query
      results, but was clearly wrong, and slowed down queries unnecessarily.
      
      * In the case that argument's lower bound is adjacent to the centroid's
      upper bound, we also don't need to visit all quadrants. Per similar
      reasoning as previous point.
      
      * The code where we compare the previous centroid with the current centroid
      should match the code where we compare the current centroid with the
      argument. The point of that code is to redo the calculation done in the
      previous level, to see if we were supposed to traverse left or right (or up
      or down), and if we actually did. If we moved in the different direction,
      then we know there are no matches for bound.
      
      Refactor the code and adds comments to make it more readable and easier to
      reason about.
      
      Backpatch to 9.3 where SP-GiST support for range types was introduced.
      1264ef31
    • Tom Lane's avatar
      Allow join removal in some cases involving a left join to a subquery. · f15821ee
      Tom Lane authored
      We can remove a left join to a relation if the relation's output is
      provably distinct for the columns involved in the join clause (considering
      only equijoin clauses) and the relation supplies no variables needed above
      the join.  Previously, the join removal logic could only prove distinctness
      by reference to unique indexes of a table.  This patch extends the logic
      to consider subquery relations, wherein distinctness might be proven by
      reference to GROUP BY, DISTINCT, etc.
      
      We actually already had some code to check that a subquery's output was
      provably distinct, but it was hidden inside pathnode.c; which was a pretty
      bad place for it really, since that file is mostly boilerplate Path
      construction and comparison.  Move that code to analyzejoins.c, which is
      arguably a more appropriate location, and is certainly the site of the
      new usage for it.
      
      David Rowley, reviewed by Simon Riggs
      f15821ee
  10. 15 Jul, 2014 5 commits